Models
Benchmark
A standard test used to compare how good different AI models are.
A benchmark is a shared exam that many models take so people can compare their scores. It might test math, coding, reading comprehension, or general knowledge. Benchmarks are useful for a rough sense of ability, but they can be gamed or grow stale, so a high score does not always mean a model is best for your real-world needs.
For example
Companies love to announce that their new model beat a popular benchmark by a few points.
Related
Reasoning modelAn AI that pauses to think through a problem step by step before answering.Mixture of expertsA big model split into specialists, only a few of which handle each question.Open weights vs closedWhether a model's inner settings are shared publicly or kept private.DistillationTraining a small, cheap model to imitate a big, expensive one.