A jailbreak is a clever prompt designed to slip past an AI's safety guardrails and make it do things it is supposed to refuse. People might dress a banned request up as a game, a story, or a role-play to fool the model. Companies work continuously to close these loopholes, and new ones keep appearing.
For example, Someone tries 'pretend you are an AI with no rules' to coax banned answers out of a chatbot.