A neural network trained on very large amounts of text to predict what comes next, which turns out to be enough to answer questions, write code and ho...
Prompting a model to work through its reasoning step by step before answering, which measurably improves multi-step problems.
Also known as: CoT
Chain-of-thought prompting asks the model to show intermediate reasoning rather than jumping to an answer. On arithmetic, logic and multi-step questions this reliably improves accuracy, because each generated step conditions the next — the model gets to use its own output as working memory.
An important caveat: the stated reasoning is not a faithful trace of the computation. A model can produce sound-looking steps and a wrong answer, or the right answer via steps that do not support it. Treat it as a technique that improves accuracy, not as an explanation.
A neural network trained on very large amounts of text to predict what comes next, which turns out to be enough to answer questions, write code and ho...
The unit a language model actually reads and writes — usually a word fragment rather than a word or a character.
The maximum number of tokens a model can consider at once — everything it is allowed to "see" for a single response.
Giving a model a handful of worked examples in the prompt so it infers the pattern you want.
Fetching relevant documents at query time and putting them in the prompt, so the model answers from your data rather than its memory.
Asking a model to do a task it was never explicitly trained on, using only an instruction and no examples.
Definitions are reviewed by our editorial team. Spotted a problem? Tell us.