LectureRechercheRadarCadre d'investissement
Connexion / Inscription
← Retour à la lecture
ActualitésSujet · CoreWeave动态Matériel2 min de lectureRédaction DisconfirmAI

CoreWeave Engineer Joël Henry: When to Use AI Agents to Build Tools vs. As Tools in Data Center Anomaly Detection

A CoreWeave blog post explains the engineering practice of distinguishing between two AI agent modes in physical infrastructure monitoring: offline construction of deterministic detectors and online open-ended reasoning. The article details how this architectural split addresses non-determinism, controls costs, and retains human control over critical decisions.

2026-10-15 19:55 GMT+8

Managing a physical system like an AI data center involves processing massive streams of telemetry data—power draw, inlet temperature, coolant flow—every second. The core challenge is identifying nodes that might interrupt training runs from this continuous flow. Joël Henry, writing for the CoreWeave engineering blog, argues that the question is not whether to use AI agents, but where to use them. Pointing an agent at every part of the problem results in a slow system capable of giving different answers on different days, because language models are inherently probabilistic.

To resolve this tension, Henry describes an architecture that assigns AI agents two distinct roles: "agents to build the tool" and "agents as the tool." In the first mode, the agent works offline, exploring data, interpreting requirements, and assembling conventional machine learning pipelines. Once finished, the agent steps away, and the production system runs deterministic code and models. This approach suits repetitive, well-defined tasks requiring constant operation, such as anomaly detection itself. It ensures the same input always produces the same output and allows results to be explained by inspecting the code.

The second mode embeds the agent inside the live system to handle open-ended problems where each case is genuinely new. When the detector flags an anomaly, the agent answers questions like "Is this real?", "What caused it?", and "What should be done?" These tasks are hard to codify in advance and require judgment across GPU, network, or storage domains. In this mode, the agent incurs a real cost per call and does not guarantee determinism, but it provides human-readable reasoning to help operators understand complex situations.

Connexion / Inscription
LectureRechercheRadarCadre d'investissement

Henry emphasizes that the key to this split lies in designing constraints. For agents building tools, engineers provide a "harness" containing tools, requirements, and evaluation standards, within which the agent iterates until metrics stop improving. For agents acting as tools, the system forces all claims to come from tool calls rather than memory, preventing hallucinations. Although agents can recommend actions, any decision affecting physical infrastructure requires human approval, ensuring safety.

This architecture applies beyond data centers to any physical system with sensor data, such as battery test rigs or robotic arms. Its core value lies in using AI's flexibility to accelerate tool development and updates, while relying on traditional engineering's determinism to ensure reliable, low-cost daily operations. Over time, patterns initially requiring agent reasoning can be codified into the deterministic system if they become regular, leading to decreasing costs.

Sources

  • wf.coreweave.com↗
Sujet

CoreWeave动态

美国AI云服务商CoreWeave在2026年10月密集发布技术产品并宣布全球扩张,但其高杠杆商业模式引发市场剧烈震荡。公司推出Forge平台及Nvidia Vera CPU支持,并在北达科他州和印度推进数据中心建设;然而,其债券收益率飙升…

7 étapes15 piècesMis à jour 2026-10-26 09:47

Comment on en est arrivé là

  1. 2026-10-02CoreWeave宣布引入英伟达Vera CPU并上线对象存储跨区域写入功能;Applied Digital在北达科他州Polaris Forge 1园区新增75兆瓦算力,总规模达250兆瓦。wf.coreweave.com ↗
  2. 2026-10-03CoreWeave发布Forge平台,旨在连接推理、观察与模型改进闭环,支持模型检查点热加载。coreweave.com ↗
  3. 2026-10-07CoreWeave宣布进入印度市场,计划与AdaniConneX合作在孟买附近部署240兆瓦数据中心容量。investors.coreweave.com ↗

Ce qui reste non résolu

  • CoreWeave能否成功以更低利率进行再融资或通过资产出售避免流动性危机?
  • Meta等超大规模客户在本季度财报中是否维持原有的巨额AI资本支出计划?
  • 随着融资成本上升,是否有更多依赖债务的数据中心项目被推迟或取消?

Également dans ce fil

  • CoreWeave Blog: The True Driver of Agent Production Costs is Context Resend in Loops; Architecture Choices Matter More Than Model Selection2026-10-23
  • CoreWeave's Min Jun: Agentic Traffic Breaks Network Assumptions Never Tested by Training2026-10-23
Lire le sujet complet →
Continuer la recherche →