Loading…
Glossary term
When a model reproduces parts of its training data instead of generalizing from it.
Large models can store pieces of their training data and repeat them word for word, especially text that appeared many times. This can include copyrighted or private material.
Memorization differs from generalization, where the model applies a learned pattern to new input.
It raises privacy and copyright concerns and complicates evaluation.