A model built from layers of simple weighted units, trained by adjusting those weights until the output matches the target.
Finding structure in data that has no labels — clusters, groupings, or a compressed representation.
Unsupervised learning works on unlabelled data, looking for structure that is already there: clustering customers by behaviour, reducing dimensions for visualisation, or learning a compressed representation.
Because there is no ground truth, evaluation is genuinely hard — you are usually judging whether the structure found is useful rather than whether it is correct.
Self-supervised learning, which generates its own labels from the data (predict the next token, fill in the masked word), is what actually trains modern language models, and sits somewhere between the two.
A model built from layers of simple weighted units, trained by adjusting those weights until the output matches the target.
When a model learns the training data so closely — including its noise — that it performs worse on anything new.
Training on examples that come with the right answer attached, so the model learns to map inputs to known labels.
Learning by acting in an environment and adjusting behaviour based on rewards, rather than from labelled examples.
Reusing a model trained on one task as the starting point for another, instead of training from scratch.
A list of numbers representing a piece of data, arranged so that similar things end up close together.
Definitions are reviewed by our editorial team. Spotted a problem? Tell us.