Chain-of-Thought
CoTPrompting a model to work through its reasoning step by step before answering, which measurably improves multi-step problems.
Read definitionPrompting a model to work through its reasoning step by step before answering, which measurably improves multi-step problems.
Read definitionThe maximum number of tokens a model can consider at once — everything it is allowed to "see" for a single response.
Read definitionGiving a model a handful of worked examples in the prompt so it infers the pattern you want.
Read definitionA neural network trained on very large amounts of text to predict what comes next, which turns out to be enough to answer questions, write code and ho...
Read definitionFetching relevant documents at query time and putting them in the prompt, so the model answers from your data rather than its memory.
Read definitionThe unit a language model actually reads and writes — usually a word fragment rather than a word or a character.
Read definitionAsking a model to do a task it was never explicitly trained on, using only an instruction and no examples.
Read definition8 subject areas across 32 definitions — start wherever you already are.
The core ideas behind systems that learn patterns from data.
7 termsNeural networks with many layers, and the machinery that trains them.
5 termsHow machines read, generate and reason about human language.
7 termsModels that produce new text, images, audio or code.
4 termsMaking sense of images and video.
1 termDatasets, labelling, evaluation and the training loop itself.
1 termAlignment, bias, interpretability and the limits of these systems.
3 termsServing, scaling and running models in production.
4 terms