Microsoft Warns AI Agents Are the New Insider Threat
Microsoft on Monday introduced new security features designed to protect enterprises from the growing threat of AI agents. The launch arrives as Microsoft continues to warn enterprises about the dangers of AI and autonomous agents.
Perhaps the most notable addition is Guardian Agents, a feature intended to monitor the AI agents a company deploys. Guardian Agents is part of Project Perception, a product Microsoft introduced in June.
From External Hackers to Internal Risks
Project Perception was Microsoft's answer to powerful hacking models such as Anthropic's Mythos and Fable and OpenAI's security vulnerability scanning system, Daybreak. The product originally launched three classes of agents:
- A "red team" that acted like hackers and attacked
- A "blue team" that detected the red team and assessed the vulnerabilities it found
- A "green team" tasked with fixing them
The product was built around the assumption that AI hackers would come from outside the company. But lately, Microsoft CEO Satya Nadella has been warning that the AI enemy may be the very agents enterprises have deployed and are paying for β much like a rogue human employee, otherwise known as an "insider threat."
Nadella: 'Separate the Supply of Intelligence From the Authority Over It'
Earlier this month, in his private blog, Nadella warned that it is time to stop trusting AI model providers, even when they offer assurances of safety and security for their agentic products. He wants enterprises to implement separate systems β not controlled by the AI labs β to watch and control the agents that those labs' products launch.
"We are deploying these complex agentic systems and models, with access to our most sensitive data and giving them the ability to take mission-critical actions on our behalf!" he wrote. "We simply can't outsource responsibility for what intelligence does on our behalf. A model provider's assurances do not relieve us of that responsibility. β¦ In other words, we need to separate the supply of intelligence from the authority over it."
'Frontier Models Cannot Be Trusted'
When announcing Guardian Agents, Microsoft's security business chief Hayete Gallot was even more direct.
"Unfortunately, frontier models, regardless of their origin, cannot be trusted," she wrote.
She added that this isn't because the models are malicious or easily hacked, but because they are unpredictable. They have been trained to complete tasks, not to follow "organizational norms or judgment." On top of that, they are often given the keys to the kingdom, with access to data and tools that could cause serious harm.
A Solution That Is Both Surprising and Self-Serving
Microsoft's solution cuts both ways. The surprising part is that Microsoft is famously close to OpenAI and Anthropic, having invested in both. OpenAI is also one of its biggest cloud customers, and Microsoft operates its own AI lab developing models. In effect, Microsoft is sowing distrust against some of its own business interests.
The self-serving part is that Microsoft wants enterprises to buy agent security products from it β the cloud provider β rather than from Anthropic and OpenAI.
Conflicting interests aside, the logic is sound: the software that monitors agent behavior should be separate from the suppliers of those agents, just as auditors should be independent of the organizations they audit.
Or, as Nadella puts it: "We need to separate the supply of intelligence from the authority over it."
Microsoft is now seizing that business opportunity β positioning itself as the independent layer of oversight for an increasingly agent-driven enterprise.
via TechCrunch AI