SemiAnalysis Podcast Ep. 034: InferenceX Team Returns to Discuss TPU v7, Vera Rubin, and Fast Tokens
SemiAnalysis released Episode 034 of its podcast, marking the return of the InferenceX team after a two-month hiatus. Host Jordan Nanos is joined by guests Cam Quilici, Bryan Shan, and Alec Ibarra to discuss Engram and DRAM offloading, the AgentX benchmark and its profit calculator, TPU v7 performance on InferenceX, Vera Rubin vs Blackwell, fast tokens technology, and TileRT on NVIDIA GPUs.
SemiAnalysis released Episode 034 of its podcast on October 2, 2026, signaling the official return of the InferenceX team after a two-month break. The episode is hosted by Jordan Nanos, featuring guests Cam Quilici, Bryan Shan, and Alec Ibarra.
According to the publisher's episode description, the discussion covers several key areas in AI infrastructure and inference optimization. Specific topics include Engram technology and DRAM offloading mechanisms, the AgentX benchmarking tool and its accompanying profit calculator, an evaluation of Google's TPU v7 chip performance on the InferenceX platform, a comparative analysis of NVIDIA's next-generation architecture Vera Rubin against the current Blackwell architecture, "Fast Tokens" technology aimed at improving inference speed, and the TileRT framework running on NVIDIA GPUs. Additionally, the episode touches upon developments related to chip startups.