NVIDIA Publishes Provisional MLPerf Results: Vera Rubin Platform Shows >10x Energy Efficiency Gain Over GB300 in Agentic Inference
NVIDIA released preliminary MLPerf Endpoints v1.0 benchmark data for its Vera Rubin NVL72 platform, indicating over 10x higher throughput per kilowatt compared to GB300 under agentic workloads.
NVIDIA published preliminary results for its latest AI superchip platform, the Vera Rubin NVL72, in the MLPerf Endpoints v1.0 benchmark suite on November 16, 2026. The data indicates that at a shared minimum end-to-end interactivity of 50 tokens per second per user, the Vera Rubin NVL72 delivers over 10 times the throughput per kilowatt of the previous generation GB300 NVL72. This result highlights the new platform's energy efficiency advantages when handling agentic workloads involving multi-turn conversations and tool calls.
The tests covered three open-source models: Kimi K3, DeepSeek-V4.1-Flash, and Qwen3.6-35B-A3B. At matched query concurrency, the Vera Rubin NVL72 achieved 3x to 5x higher end-to-end interactivity. Conversely, at fixed interactivity thresholds, it demonstrated 5x to 10x higher throughput per kilowatt. For instance, running Kimi K3 at 1,024 concurrent queries, the Vera Rubin system achieved 41,414 tokens/sec with 100.89 kW power consumption, whereas the GB300 system reached only 13,905.8 tokens/sec at 60 kW under the same concurrency.
NVIDIA attributes these gains to the Rubin GPU architecture's HBM4 memory, Tensor Cores, and sixth-generation NVLink, combined with context-aware serving techniques like prefix caching, state reuse, and Dynamo routing. These optimizations reduce redundant computation and balance load. Additionally, model-specific execution optimizations, such as DeepSeek's MegaMoE kernel and Qwen's multi-token prediction with Tensor Core verification, help minimize data movement and sequential decoding steps.
It is crucial to note that these results are marked as "provisional" and have not yet undergone final peer review and verification by the MLCommons Association, meaning they are subject to change. The GB300 results used for comparison have been verified by MLCommons. For readers tracking AI infrastructure efficiency, this data offers an early reference for new hardware performance under standardized agentic loads, though real-world production metrics await independent validation.