LeituraPesquisaRadarFramework de investimento
Entrar / Cadastrar
← Voltar para a leitura
NotíciasTópico · CoreWeaveMaterial3 min de leituraEditorial DisconfirmAI

Jacob Yundt, Senior Director of Compute Architecture at CoreWeave: When the Data Center Itself Becomes a Computer

In a VAST Data podcast, Jacob Yundt, Senior Director of Compute Architecture at CoreWeave, explains the architectural shift in AI infrastructure—from servers to racks to entire data centers as single computing units—and how this perspective dictates the operational constraints and GPU utilization economics of neocloud companies.

2026-10-28

In a recent episode of the VAST Data podcast, Jacob Yundt, Senior Director of Compute Architecture at CoreWeave, articulated a core judgment: in large-scale AI infrastructure, the definition of a computer is expanding. From the server as the computer, to the rack as the computer, and ultimately to the entire data center as the computer—this is not rhetoric, but a gradual displacement of operational reality.

Yundt’s career spans IBM mainframes, scale-out CPU infrastructure, and today’s hyperscale GPU environments. He observes that what has changed most is not the performance of individual components, but the degree to which all parts must be designed together. In large-scale GPU systems, compute cannot be considered separately from networking, storage, power, and cooling. A rack-level system must be managed as a whole—including how power is delivered, how it is cooled, and how workloads are scheduled onto it. As density increases, this coordination expands from the rack to rows, and eventually to the entire data center.

This judgment has direct implications for understanding the competitive landscape of neocloud companies. When the data center itself becomes a unit that needs to be engineered, observed, and managed, simply stacking GPU quantities no longer constitutes a barrier. The real constraints lie in whether power distribution can adjust dynamically to demand, whether cooling solutions can keep pace with increasing rack density, and whether network topology can tolerate a single link flap across thousands or tens of thousands of GPUs without causing an entire distributed training job to collapse. Yundt noted that even a minor link flap can destroy a training job spanning tens of thousands of GPUs—which is precisely why CoreWeave embeds hardware validation, automation, and observability into its architecture rather than adding them as an afterthought.

Entrar / Cadastrar
LeituraPesquisaRadarFramework de investimento

Inference workloads introduce another dimension of complexity. Training tends to use the largest, newest clusters, but inference can efficiently utilize a broader range of GPU generations and types. Different model sizes and workload characteristics can be matched to different hardware. This places greater responsibility on the software layer: CoreWeave needs to enable customers to place workloads on the correct hardware while balancing performance, cost, and available capacity. Spot instances are one example—allowing otherwise idle GPU capacity to serve workloads that can tolerate interruption. Power allocation itself also becomes an optimization target, moving dynamically within the data center according to demand.

Yundt predicts that within five years, current practices regarding power delivery, cooling, cabling, and the connection between GPUs and CPUs and storage will appear surprisingly primitive. The industry has been accommodating each new generation of hardware through incremental evolution of existing data center designs, but the scale and density now arriving in AI infrastructure may require more fundamental changes.

Boundaries to note: This is a retelling of an interview published on the VAST Data blog. VAST is CoreWeave’s storage supplier, and the two parties have commercial interests. The 'data center as computer' framework may simultaneously represent a genuine technical assessment and a customer-facing marketing narrative. Yundt’s five-year prediction is a personal estimate, without provided trackable milestones or verification conditions. Furthermore, CoreWeave’s specific operational data—such as GPU utilization rates, failure rates, and the proportion of power costs—were not disclosed in the conversation, leaving readers unable to independently verify whether this architectural approach truly translates into economic advantage.

Fontes

  • vastdata.comVAST Data↗
Tópico

CoreWeave

CoreWeave正推动AI基础设施的架构位移,其计算架构高级总监Jacob Yundt提出“数据中心即计算机”的理念,主张将机架乃至整个数据中心视为单一逻辑系统进行协同设计。这一转变旨在解决大规模GPU集群中电力、冷却与网络调度的复杂性,…

4 etapas1 peçasAtualizado 2026-10-29 20:06

Como chegamos aqui

  1. 2026-02-26CoreWeave公布2025年第四季度财报,预计2026年资本支出为300亿至350亿美元,较2025年的149亿美元大幅翻倍,股价盘后下跌逾8%。channelnewsasia.com ↗
  2. 2026-05-07CoreWeave上调2026年资本支出下限至310亿美元(原为300亿),上限保持350亿美元不变,理由是组件价格上涨,导致股价盘后下跌超9%。channelnewsasia.com ↗
  3. 2026-10-27CoreWeave宣布构建首个专为AI设计的全球骨干网,连接北美和欧洲的51个活跃数据中心,并计划于2026年第四季度起在中东和亚太地区扩展节点。coreweave.com ↗

O que ainda está indefinido

  • CoreWeave能否在资本支出持续高位运行的情况下,有效改善调整后营业利润率?
  • 全球骨干网的部署进度是否符合预期,特别是在亚太和中东地区的落地情况如何?
  • ‘数据中心即计算机’的架构转型是否已显著降低因硬件故障导致的训练任务中断率?
Ler o tópico completo →
Continuar pesquisando →