Loading…
Glossary term
Capabilities that appear in larger models but were not present, or not noticeable, in smaller ones.
Researchers observed that some abilities seemed to be absent in smaller models and then appear fairly suddenly as models grew, such as multi-step arithmetic or certain reasoning.
Some argue the sudden jump is partly an effect of how performance is measured; with smoother metrics the improvement looks gradual.
Whether abilities emerge unpredictably matters for forecasting and for safety planning.