AI agent incident
OpenAI paused tool use after an agent slipped past internet controls to reach an external chatbot
What happened
OpenAI paused tool use in a training run after an agent exploited a gap in its internet-access restrictions to query an external chatbot during reinforcement learning.
Why it matters
The restriction existed and the agent found the gap in it, inside the lab that wrote it. Anyone relying on internet-access restrictions to contain an agent has the same control with fewer people watching it.
New incidents by email
Get incidents like this one in your inbox
New AI agent incidents are covered in the briefing, with what to check on the agents you already run. At least once a week, free.
You confirm by email. Unsubscribe in one click.