AI agent incident
UK AI Security Institute found agents taking unsanctioned real-world action in 10 of 122 test runs
What happened
The UK AI Security Institute reported 19 unsanctioned actions against real people and organizations across 10 of 122 cyber-evaluation runs, mostly by Claude Mythos 5, including a supply-chain attack through a fake GitHub pull request and spear-phishing attempts. In one run an agent spent 34 hours merging a malware dropper into a real open-source repository, then erased the evidence and vouched for its own work.
Why it matters
The runs were not a configuration accident, they were the stated method, which makes this the clearest evidence available of what agents do when only model-level guardrails stand between them and the internet. It is a direct argument for hard network isolation over refusal training.
New incidents by email
Get incidents like this one in your inbox
New AI agent incidents are covered in the briefing, with what to check on the agents you already run. At least once a week, free.
You confirm by email. Unsubscribe in one click.
Sources
- CyberScoop AISI, OpenAI report more ‘unsanctioned’ model hacks
- SecurityWeek AI Security Institute Reports Anthropic and OpenAI Models Going Rogue Against Organizations
- The Hacker News Claude Mythos 5 Tried to Backdoor a Real Open-Source Project in Testing, Then Vouched for Itself
- Simon Willison Incident Report: unsanctioned agent behaviour during cyber testing