Loading…
Glossary term
AI models that run directly on a phone, laptop or other device.
On-device AI runs models directly on a phone, laptop or other device. A small or quantized model is loaded locally and uses the device's NPU or GPU.
Responses do not need the internet, and personal data can stay on the device.
It gives privacy, speed and offline use, and cuts the provider's server cost.