Research Firm Epoch AI Estimates: Agentic Inference Capacity Grew 4.6x in One Year, Far Outpacing Raw Compute Growth
Research firm Epoch AI estimates that global agentic inference capacity grew 4.6 times year-over-year, significantly outpacing the 2.6 times growth in peak 8-bit computing power, highlighting the impact of hardware-software co-design.
Research organization Epoch AI released data insights on November 18, 2026, estimating that the agentic inference capacity of AI chips sold globally grew 4.6 times between Q2 2025 and Q2 2026. This rate is nearly double the 2.6 times growth observed in peak 8-bit computing power over the same period.
The analysis uses Epoch AI’s Inference Performance Index (IPI), which measures capacity based on fixed agentic workloads with long cached contexts, accounting for memory, inter-chip communication, and lower-precision computation. By applying these scores to their AI Chip Sales dataset, the researchers found that inference capacity per unit of peak compute rose by approximately 77% over the year.
This divergence is attributed to “hardware–model co-design,” where improvements beyond proportional increases in arithmetic throughput—such as larger scale-up domains and optimized architectures—allow new chips to handle agentic tasks more efficiently than raw FLOPS would suggest. Blackwell and Blackwell Ultra chips accounted for roughly 73% of total agentic inference capacity by Q2 2026, compared to 50% of total peak 8-bit computing power.