Reading OpenAI’s account last week of how some of its models broke containment and hacked into the computer systems of Hugging Face, another AI company, was the first time I felt genuine chills about what large language models can now do. But this is a case of human hubris—not rogue AI.

I am not an alarmist. In fact, I’ve been pushing back against AI scare stories for years. Even so, this incident crosses a line. I believe it’s the clearest illustration yet of how the people building and testing this technology are repeating predictable mistakes, and why the market is beginning to take notice.