Google and Meta Open-Source TorchTPU to Enable Native PyTorch on TPUs, Challenging Nvidia's Dominance
Google and the PyTorch team under Meta announced TorchTPU, an open-source AI development stack designed to make it easier for PyTorch to run on Google TPUs, aiming to attract developers and challenge Nvidia's long-standing monopoly.
ImportanceMaterialEvidenceE3 inspectableWrite-upStandard
The PyTorch teams at Google and Meta announced TorchTPU, an open-source AI development stack, on Tuesday. The core goal of this tool is to make it easier for PyTorch to execute on Google TPUs, thereby attracting the application development community and challenging Nvidia's long-standing dominance in the AI compute market.
TorchTPU was the most significant product among several announced by Google at the PyTorch 2026 conference. It enables PyTorch to run natively on Google Cloud TPUs, allowing developers to use their familiar tools—such as vLLM, SGLang, llm-d, TorchTitan, Ray, TorchRec, HuggingFace, and LiteRT—to train, deploy, and serve models.
According to the TorchTPU webpage documentation, the tool was co-developed by Google and PyTorch. It allows existing PyTorch workloads to run on Google's own TPUs with minimal code changes, using familiar APIs. TorchTPU provides a TPU PyTorch Aten core implementation, compilation caching for XLA execution, support for distributed training (including data parallelism and tensor parallelism), examples for various models (such as Llama, Qwen, ResNet, DLRM, minGPT, and UNet), as well as debugging and benchmarking tools.
Google stated that developers can first develop and debug in eager mode, then optimize TPU utilization and reduce memory usage via torch.compile to improve performance in production environments. Additionally, Google has partnered with Hugging Face to allow open-source models on its platform to run natively on TorchTPU. In the Transformers v5 library, deploying models to Google Cloud TPUs now only requires setting device_map="tpu".