On-device AI means the model runs locally on your own hardware rather than in a company's data center. Because your data never has to leave your device, it can be more private and can work without an internet connection. The trade-off is that phones and laptops are smaller than data centers, so on-device models are usually lighter and less powerful.
For example, Your phone transcribing a voice note without sending the audio anywhere is on-device AI at work.