Loading…
Glossary term
The part of a model that generates output from an internal representation.
A decoder generates output one piece at a time, using what it has already produced and, in some designs, an encoder's representation. A decoder-only transformer predicts the next token over and over. Most large language models today are decoder-only.
The decoder is the 'writing' half of a model, and decoder-only transformers are the design behind chat assistants.