Models store their knowledge as huge lists of precise numbers, and quantization trims those numbers down to simpler, rougher versions. Like compressing a photo, this makes the model much smaller and quicker to run while keeping most of its quality. It is a key trick for fitting powerful AI onto ordinary hardware.
For example, Quantization can shrink a model enough to run on a phone instead of a data center.