ReadingResearchRadarInvestment frameworkAI Company Primary Sources
Sign in / Sign up
← Back to reading
NewsMaterial3 min readDisconfirmAI Editorial

Jacob Yundt, Senior Director of Compute Architecture at CoreWeave: When the Data Center Itself Becomes a Computer

In a VAST Data podcast, Jacob Yundt, Senior Director of Compute Architecture at CoreWeave, explains the architectural shift in AI infrastructure—from servers to racks to entire data centers as single computing units—and how this perspective dictates the operational constraints and GPU utilization economics of neocloud companies.

2026-10-28 08:00 GMT+8

In a recent episode of the VAST Data podcast, Jacob Yundt, Senior Director of Compute Architecture at CoreWeave, articulated a core judgment: in large-scale AI infrastructure, the definition of a computer is expanding. From the server as the computer, to the rack as the computer, and ultimately to the entire data center as the computer—this is not rhetoric, but a gradual displacement of operational reality.

Yundt’s career spans IBM mainframes, scale-out CPU infrastructure, and today’s hyperscale GPU environments. He observes that what has changed most is not the performance of individual components, but the degree to which all parts must be designed together. In large-scale GPU systems, compute cannot be considered separately from networking, storage, power, and cooling. A rack-level system must be managed as a whole—including how power is delivered, how it is cooled, and how workloads are scheduled onto it. As density increases, this coordination expands from the rack to rows, and eventually to the entire data center.

This judgment has direct implications for understanding the competitive landscape of neocloud companies. When the data center itself becomes a unit that needs to be engineered, observed, and managed, simply stacking GPU quantities no longer constitutes a barrier. The real constraints lie in whether power distribution can adjust dynamically to demand, whether cooling solutions can keep pace with increasing rack density, and whether network topology can tolerate a single link flap across thousands or tens of thousands of GPUs without causing an entire distributed training job to collapse. Yundt noted that even a minor link flap can destroy a training job spanning tens of thousands of GPUs—which is precisely why CoreWeave embeds hardware validation, automation, and observability into its architecture rather than adding them as an afterthought.

Sign in / Sign up
ReadingResearchRadarInvestment frameworkAI Company Primary Sources

Inference workloads introduce another dimension of complexity. Training tends to use the largest, newest clusters, but inference can efficiently utilize a broader range of GPU generations and types. Different model sizes and workload characteristics can be matched to different hardware. This places greater responsibility on the software layer: CoreWeave needs to enable customers to place workloads on the correct hardware while balancing performance, cost, and available capacity. Spot instances are one example—allowing otherwise idle GPU capacity to serve workloads that can tolerate interruption. Power allocation itself also becomes an optimization target, moving dynamically within the data center according to demand.

Yundt predicts that within five years, current practices regarding power delivery, cooling, cabling, and the connection between GPUs and CPUs and storage will appear surprisingly primitive. The industry has been accommodating each new generation of hardware through incremental evolution of existing data center designs, but the scale and density now arriving in AI infrastructure may require more fundamental changes.

Boundaries to note: This is a retelling of an interview published on the VAST Data blog. VAST is CoreWeave’s storage supplier, and the two parties have commercial interests. The 'data center as computer' framework may simultaneously represent a genuine technical assessment and a customer-facing marketing narrative. Yundt’s five-year prediction is a personal estimate, without provided trackable milestones or verification conditions. Furthermore, CoreWeave’s specific operational data—such as GPU utilization rates, failure rates, and the proportion of power costs—were not disclosed in the conversation, leaving readers unable to independently verify whether this architectural approach truly translates into economic advantage.

Sources

  • vastdata.comVAST Data↗
Continue researching →