Google Open-Sources TorchTPU: Enables Native PyTorch Execution on TPUs to Challenge NVIDIA Ecosystem
Google launches the open-source TorchTPU project, allowing seamless migration of PyTorch models to TPUs without code rewrites, aiming to weaken NVIDIA's software monopoly in AI computing.
On October 21, 2026, U.S.-based Google announced at the North American PyTorch Conference that it has officially open-sourced a project named TorchTPU. This tool allows developers' existing PyTorch artificial intelligence applications to run directly on Google's custom Tensor Processing Units (TPUs) without rewriting underlying code. The move is seen as a key step by Google joining competitors like Amazon in an attempt to break the long-standing dominance of NVIDIA's AI hardware and software ecosystem.
PyTorch is one of the most popular open-source machine learning frameworks, with data suggesting that approximately 85% of AI applications are built upon it. Since PyTorch was originally developed by Meta in 2016 primarily for NVIDIA GPUs, many of its functions default to relying on the CUDA ecosystem. TorchTPU provides native support, enabling existing PyTorch-based applications to be easily ported to TPUs and Google Cloud services; developers can achieve this simply by changing basic configurations.
Notably, just two days prior on October 19, U.S.-based Amazon also launched a similar tool called TorchNeuron, designed to allow AI applications to migrate to its custom Trainium chips and AWS platform without re-coding. The successive actions by these tech giants indicate that competition in AI chips has extended from pure hardware performance and cost to control over the software ecosystem. In the past, NVIDIA established a deep moat through the tight binding of CUDA and PyTorch; now, Google and Amazon are attempting to attract more workloads to their custom chips by lowering migration barriers.
Beyond basic compatibility, Google emphasized close collaboration with Meta, Hugging Face, and the development teams behind vLLM and SGLang to ensure that TorchTPU's function libraries integrate smoothly with original PyTorch. Additionally, Google released the TPU agent suite, a helper tool to assist developers in fixing errors and optimizing performance during the migration process. While this initiative lowers technical barriers, actual performance and stability in production environments still require broader independent verification.