SemiAnalysis released the first cross-model results for TPUv7 (Ironwood) on the InferenceX/AgentX agent inference benchmark on November 5, 2026. AgentX simulates real-world agent workloads characterized by multi-turn interactions, long contexts, and high prefix reuse, which differ significantly from single-turn chat scenarios. This release covers four models: Meta's Muse Spark Open (816B parameters), Zhipu AI's GLM-5.2/5.3 (744B parameter MoE), Alibaba's Qwen3.5 397B, and Moonshot AI's Kimi K3 (2.8T parameters).
At FP8 precision, the results for each model must be viewed separately. On GLM-5.2, within an interaction range of 60 to 300 tokens per second per user, TPUv7 delivers 1.2 to 2.7 times more tokens per dollar than the B200, B300, and AMD MI355X. On Qwen3.5 397B, SemiAnalysis reports that TPUv7 FP8 performance per dollar is 1.67 times that of the GB300 NVL72 FP4—this marks the first AgentX model result submitted by Google itself. On Kimi K3, results submitted by Inferact, founded by the vLLM founding team, show that TPUv7 delivers 1.15 to 2.5 times more tokens per dollar than the GB200, B200, B300, and MI355X. Muse Spark Open was submitted by RadixArk, maintained by SGLang, achieving competitive decode cost-effectiveness even on a GPU-optimized architecture theoretically unfriendly to TPUs.
However, SemiAnalysis notes that NVIDIA FP4 still maintains a lead in pure performance per dollar. On GLM-5.2, at 100 tok/s/user, the GB300 and GB200 FP4 deliver 3.6x and 3.5x more tokens per dollar than TPUv7, respectively. This is because FP4 halves the weight bytes, and small-batch decode is memory-bandwidth bound. TPUv7 currently lacks native FP4 support, with this feature expected to arrive with TPUv8 in Q1 2027. NVIDIA submitted FP4 counter-results on Qwen3.5; while these exceeded TPUv7 FP8 in decode performance, they came at the expense of prefill, resulting in lower end-to-end performance than TPUv7 FP8.
SemiAnalysis's core argument is that TPUv7's competitiveness stems not just from hardware specifications but from ecosystem collaboration with upstream maintainers such as vLLM (Inferact, RedHat), SGLang (RadixArk), llm-d, PyTorch, and Ray. Meta has already deployed TPUv7 in production using SGLang-TorchTPU. Kimi K3.1 Pro received TPUv7 support on its release day. SemiAnalysis argues that NVIDIA's moat is being eroded from its software ecosystem, citing bureaucratic processes—such as a three-month legal review required for driver feature approvals—as a structural risk.
It is important to emphasize that the submitters of the above results vary: Qwen3.5 was submitted directly by Google, Muse Spark Open by RadixArk, and Kimi K3 by Inferact. All data are first-party results analyzed and published by SemiAnalysis and have not yet been independently reproduced. Regarding NVIDIA, preview submissions for the Rubin NVL72 suggest its performance per dollar could reach 6 times that of TPUv7, but SemiAnalysis points out this is an unfair comparison; Rubin should be benchmarked against TPUv8i rather than TPUv7. For readers making compute procurement decisions, these figures provide directional reference, but independent verification should be requested before making commitments.