Artificial intelligence · lesson 1 of 4
Generative models, tokens and useful prompts
An autoregressive language model predicts successive tokens from context. A token may be a word piece, punctuation or another encoded unit.
Learn the ideas
Prerequisites: AI basics, reading and structured instructions.
Generation
An autoregressive language model predicts successive tokens from context. A token may be a word piece, punctuation or another encoded unit.
Prompting
State the task, relevant context, constraints and desired format. Examples can clarify the task, but they can also bias the response.
Context
The context window is finite and measured in model-specific tokens. Word counts are not a universal token-count conversion.
Checking
Generation can produce plausible unsupported content. Important outputs need verification, and private data should not be included without authorization.
Worked examples
Must one token equal one English word?
Tokenization depends on the vocabulary and encoding.
No
Which prompt is better specified for a study task?
A clear task and evidence boundary are testable.
Summarize the supplied passage in five factual sentences and flag missing evidence
Check your understanding
8 questionsDecimals or fractions are accepted for numeric answers. Proofs and written responses use sample answers and require human marking. This is practice, not a protected examination.
Further reading and review references
These are reference links, not copied exercises, institutional endorsement or proof of independent review.