An AI safety institute is an official organization set up by a government to examine powerful AI systems and understand their risks. These bodies test frontier models, develop safety standards, and advise on policy, often working with the companies building the models. Several countries have created them as AI has grown more capable and consequential.
For example, A national AI safety institute might evaluate a new model for dangerous capabilities before it is widely released.