Amazon Takes Its Biggest Shot at Nvidia Yet with New TorchNeuron Developer Tool
On Monday, Amazon Web Services (AWS) released a tool called TorchNeuron that allows AI startups to easily move their AI applications onto Amazon's AI chip, Trainium. In doing so, Amazon is also taking direct aim at the software advantage that has helped Nvidia become the default hardware choice for AI applications—and spurred its rise as the AI hardware provider of choice.
How TorchNeuron Works
TorchNeuron works with PyTorch, a free, open-source toolkit that developers use to build, train, and run AI models. According to Amazon, it lets AI applications written with PyTorch run on Trainium by changing just one line of configuration—no code rewrite required.
Amazon says about 85% of AI applications are written with PyTorch. Facebook originally developed the framework, but since 2022 it has been part of the Linux Foundation, which maintains open-source projects. Nvidia has spent years ensuring its CUDA software—the software infrastructure that allows applications to run on Nvidia GPUs and other hardware—seamlessly supports AI applications written with PyTorch. As a result, Nvidia's hardware is now deeply embedded in the toolkit, essentially by default.
A Familiar Path, But With AWS-Scale Advantages
TorchNeuron is adapted from PyTorch, so developers who know PyTorch already know how to use it. Amazon isn't the first company to attempt to make it easy to bring its chips to the platform. PyTorch users can also port their applications to AMD GPUs or even Apple's chips with a simple configuration change.
However, Amazon argues that porting to Trainium isn't just easy—it also gives AI startups access to Amazon's entire cloud. Unsurprisingly, AWS claims this is a better choice for startups than using neoclouds, many of which are tied to Nvidia and its hardware, such as CoreWeave, Nebius, and Firmus.
"You're building on AWS. You're not betting on a single-purpose compute provider and scrambling to build everything else around it," Colin Brace, VP of Technology Software at AWS Annapurna Labs (the unit that makes Amazon's custom chips), told TechCrunch via email. "On AWS," he continued, "the infrastructure to go from prototype to production is already there, allowing a founder to move fast and scale when they need to."
AWS says that because the same chip handles both training (teaching the AI model) and inference (putting the finished model to work, as when it answers a user's question), and because it is tightly integrated with the cloud infrastructure that startups need, its cloud will save them money—even if AWS doesn't offer the cheapest per-token price.
"Trainium's value is price-performance plus the fact that it's one platform for both training and inference, which improves the economics across a full workload," Brace said. "Look at Deepgram—they moved to Trainium using native PyTorch support, and they're processing 70% more audio per dollar at production-grade accuracy." Deepgram is an AI voice application provider and a competitor to ElevenLabs.
Pushing PyTorch Beyond Nvidia
But Amazon isn't content to simply give PyTorch application developers an easy option to move to its cloud. Amazon also says it is pushing PyTorch to be less automatically centered on Nvidia, and it will contribute the code to do that to the main PyTorch project. In the blog post announcing the new tool, the company wrote:
"Amazon's approach extends beyond its own hardware. The company is contributing changes upstream to PyTorch itself, working with the PyTorch community to remove code that ties the framework to specific chips. The goal is to make PyTorch more hardware-agnostic for the entire developer community, not just Trainium users."
While such a tactic is undoubtedly good for those selling hardware and cloud services that compete with Nvidia, one of the points of PyTorch is to hide all the pesky difficulties of getting AI code to run on hardware. We'll have to wait and see whether pushing Nvidia out that far gives developers more choice and more affordable options, as Amazon promises—or just more configuration headaches.
The Takeaway for 2026
As the AI hardware market continues to mature in 2026, Amazon's TorchNeuron represents a significant escalation in the platform war between cloud providers and Nvidia. With Nvidia's CUDA ecosystem still deeply entrenched and enterprise AI budgets increasingly scrutinized, the battle over developer tooling—and the default hardware choices embedded within it—will likely define the next phase of AI infrastructure competition. Whether TorchNeuron becomes a genuine alternative or remains a niche option for cost-sensitive workloads will depend largely on how quickly AWS can close the performance and ecosystem gap.
via TechCrunch AI