ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsMaterial3 min readDisconfirmAI Editorial

AMD Zen Original Architect Mike Clark Explains Zen 6 Design Shift: Dense Cores Become Highest IPC Performance Core

In a Chips and Cheese interview, Mike Clark explained the core hierarchy reversal in the Zen 6 family—dense technology (Zen 6c) is no longer an area optimization but has become the highest IPC performance core due to the activation of full L3 cache (4MB per core), while the classic design has been repositioned as the high-frequency variant. He detailed specific decisions including queue expansion to extract additional IPC despite lower frequencies, scheduler trade-offs reducing integer multipliers from three to two, the addition of VNNI pipelines to supplement AI inference, and reduced branch prediction latency.

2026-11-12 06:22 GMT+8

Mike Clark, AMD's original Zen architect, explained a fundamental design shift during an AMD In-Depth interview with Chips and Cheese: starting with the Zen 6 generation, AMD's dense technology cores are no longer area-optimized products but serve as the highest IPC performance cores. He explicitly stated that while dense technology was previously just an area trade-off, this generation's team leveraged it to add extra IPC within the core. The classic design is now repositioned as the high-frequency version, while dense technology serves as the top-tier performance core because full L3 cache has been enabled in this implementation, providing 4MB per core, totaling 128MB for 32 cores, and delivering the highest achievable IPC.

The mechanism behind this reversal is not mysterious. Clark explained that because Zen 6c targets lower frequencies than the high-frequency cores, it can accommodate more capacity in its queues—the floating-point scheduler is just one example; other queues throughout the core are larger in Zen 6c, aiming to extract more IPC and gain leverage in SMT environments. He simultaneously emphasized a design principle: there should be no software-differentiating delta between the two architectures, meaning the same optimizations apply to both.

Regarding AI inference capabilities, Zen 6 adds two VNNI pipelines on the vector side. Clark admitted this was not the initial design goal—they did not use the term 'agentic' when they began designing. However, Zen 5 had already established a new foundation for AI workloads, and the team always believed the core had a place in AI: orchestration, data type manipulation, and small model inference. Observing the direction of inference workloads, they decided to add VNNI pipelines. Since these are long-cycle projects and the floor plan was already set, this was a relatively late decision, but the team ultimately succeeded in squeezing in the extra pipelines.

Sign in / Sign up
ReadingResearchRadarInvestment framework

There is a counter-intuitive reduction in the execution engine: the number of integer multipliers decreased from three in Zen 5 to two. Clark explained that Zen 5 used a more unified scheduler, where adding a third multiplier to the scheduling group was simple and did not increase complexity. However, Zen 6 required returning to a more distributed scheduler to scale the architecture; that extra multiplier did not yield significant gains in Zen 5, so to optimize area and the scheduler, they reverted to two multipliers.

The frontend also saw improvements. Zen 5's dual-decode setup made it difficult for a single thread to synchronize instruction cache and operation cache fetches in larger workloads. Zen 6 spent considerable time optimizing this, improving efficiency from both delivery and power perspectives. Regarding branch prediction, misprediction recovery latency was reduced, and accuracy saw a slight improvement. Clark stated they do not intend to expand the branch prediction structure but rather layout TAGE tables more efficiently, while focusing each generation on restarting execution as quickly as possible after a misprediction.

Vector loads increased from two in Zen 5 to four (256-bit). Since Zen 5 could already perform two 512-bit loads, the 1,024 wires were already present; splitting their usage was simply more complex than using them contiguously. The L2 cache bandwidth issue was also resolved: Zen 5 prefetchers would sometimes preempt L2 bandwidth, whereas Zen 6 ensures prefetches and demand requests can run in parallel continuously, delivering the full 64 bytes per cycle.

Interviewer George Cozma reported a measured result: Zen 6c matched AMD's fastest Zen 5 server CPU in SPECint 2026, despite the frequency disadvantage. This provides a concrete anchor for Clark's IPC argument, but remains a vendor-side observation based on a single benchmark test and has not yet undergone independent verification.

All technical details stem from first-party statements by AMD architects. Clark also acknowledged that some content constitutes undisclosed secrets—for instance, the specific techniques for maintaining bandwidth within the L3 mesh. Readers should view these as explanations of design intent rather than independently verified performance guarantees.

Sources

  • chipsandcheese.com↗
Continue researching →