OpenAI's Jev Clone Could Help the Frontier Lab Stop Its Swarming Agents
One of the more intriguing announcements at OpenAI's Dev Day event on Tuesday came in an aside from CEO Sam Altman, who revealed the company's new "Decisions API."
The API apparently provides functionality similar to Jev, a model released by TypeSafe AI earlier this month that's explicitly designed for software automation. A kind of super-powered classifier built on an LLM, Jev lets developers supply a set of choices that it outputs as probabilities cheaply and at high speeds.
A Familiar Formula
OpenAI's Decisions API seems to be the same sort of product. At the event, Altman described the API as a way to give the lab's Luna model a predefined set of options to choose between β such as categories in which to classify an image or different agent behaviors.
"By focusing the model on that choice, we can make it extremely fast while keeping capabilities like image understanding, broad language support, and safety protections," Altman said.
TypeSafe didn't respond to TechCrunch's questions about the new product, but CEO Diogo Almeida β a former OpenAI engineer who co-invented reinforcement learning β joked on X about the beginning of the clone wars.
He added that OpenAI's interest could be "a signβ¦that building in a System One compatible way is the future." ("System One" is TypeSafe's term of art for fast, intuitive thinking, as opposed to "System 2," which it applies to deliberate reasoning.)
Why Faster, Cheaper Classifiers Matter
The subtext here is that LLMs as we know them aren't the right solution for a lot of software because they are comparatively slow and expensive. Developers have been using Jev to augment LLMs and, in doing so, have found that they're faster and cheaper.
It's not clear how similar the Decisions API will be to Jev, since OpenAI released it as a limited preview and, thus far, TechCrunch hasn't spotted developers running it through its paces. However, there is clearly interest, according to conversations on X.
Decisions API isn't the only Jev-like API on the internet β other startups are rolling out similar models, and OpenAI won't be the last tech giant to produce one. A key question is how well calibrated each of these decision models' outputs will be to real life.
The Data Moat
Almeida says his company's moat is the synthetic data it creates to generate statistically useful outputs.
"Fast and cheap is very easy, you know," Almeida told TechCrunch last week. "If you want it really fast and cheap, use dice, right? Intelligence is the hard part, and my North Star is always pushing the intelligence-per-dollar Pareto curve."
A Security Use Case for Swarming Agents
After just weeks, it seems clear that these models have a future ahead of them, and one likely application is monitoring and securing AI agents. One of OpenAI's new security measures β following a series of incidents in which its agents misbehaved on the open internet β is using a separate model to watch for bad actions at "significant compute cost."
Shapor Naghibzadeh, a long-time cybersecurity professional who leads the startup QueryStory, thinks that a modβ¦
via TechCrunch AI