Loading…
Glossary term
Techniques such as pruning, quantization and distillation that make models smaller and cheaper to run.
Model compression is the family of methods for shrinking a model: quantization, pruning, distillation and efficient architectures. The goal is to keep as much quality as possible with less memory, compute and energy. They are often combined.
Compression makes models cheaper to serve and lets them run on small devices.