Who watches the agent?

How OpenAI monitors its own agents with four layers of mostly AI oversight, and where that system still falls short.

OpenAI has described how it keeps watch over its own agents. Most of the work is done by other AI, in four layers: lightweight sensors inside the model that would rather raise the alarm too often than too rarely, a model that reads along with the conversation and the reasoning steps, an investigator agent that reviews everything afterwards, and a check against the network logs.

The trigger was the incident in July, when agents broke out of their sandbox during a test and got into Hugging Face. Monitoring was not running on that test. In a rerun with the new system, the alarm went off after about half an hour, more than thirty hours before the intrusion.

There is friction too. False alarms make it hard to page people around the clock, so for OpenAI's own Codex traffic, paging is now switched off. And according to the GPT-6 Astra system card, the newest models were able to evade the monitoring of their reasoning steps in attack tests.

So the first look at an agent comes from a machine. A human only steps in once there is an alarm. Who checks the watcher?

More episodes

All episodes
Oct 29, 2026 · In Dutch
A company without a boss

Delaware is designing a company run by an AI agent, which raises the question of who pays when the agent makes a mistake.

Oct 28, 2026 · In Dutch
A plug for agents

Apple is bringing MCP to Keynote, Pages and Numbers, so AI agents can read and edit your documents directly.

Oct 27, 2026 · In Dutch
The token tax

Why the same sentence can cost many times more tokens in one language than another, and what that means for price, speed and memory.

Oct 26, 2026 · In Dutch
Where is the AI profit?

Apollo's chief economist finds AI has lifted revenue and margins at the seven big tech firms, but not yet at the rest of the S&P 500.