ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsTopic · AI推理成本优化Material3 min readDisconfirmAI Editorial

Cheaper AI Inference Means the Industry Spends More: The Mismatch Between Efficiency Dividends and Capital Returns

The Sequence's editorial connects this week's multiple AI developments—DeepSeek's open-source inference framework, NVIDIA's modular AI factory design, Meta's negative free cash flow, SpaceX's AI division revenue surpassing Starlink, and legal AI company Legora's $8.8 billion valuation—into a single economic argument: falling inference costs expand total demand, thereby driving up infrastructure spending, but who captures the growth and who owns the profit margins remain unresolved questions.

2026-10-25 19:03 GMT+8

AI is becoming more efficient, which apparently means everyone needs to spend more money on it. This is the core paradox outlined in The Sequence's editorial this week. The author brings together several seemingly unrelated events: China-based AI lab DeepSeek open-sourced its production inference framework DeepInfer; NVIDIA unveiled the modular AI factory design DSX POD at GTC Berlin; Meta reported quarterly revenue growth of 26% to $64.6 billion but with negative free cash flow of $2.1 billion; SpaceX's AI business generated quarterly revenue of $7.56 billion, exceeding Starlink's $5.25 billion; and legal AI company Legora completed a $550 million financing round at an $8.8 billion valuation.

The economic logic behind these events runs along the same line: as inference costs fall, developers can afford more requests, more requests mean higher total demand, and higher total demand means more infrastructure. DeepSeek's DeepInfer framework does not create new demand itself; it provides the inference core—caching and load balancing still need to be built by operators—but its economic intent is direct: squeeze more output from expensive hardware. The author summarizes the endpoint of this logic with one sentence:

"Efficiency can sell GPUs. Intelligence is impressive. Intelligence with a better gross margin is what gets you to open the spreadsheet."

Sign in / Sign up
ReadingResearchRadarInvestment framework

NVIDIA's DSX POD claims to compress deployment time from six months to fourteen days, but the author specifically points out that the condition of having a "prepared site" is crucial: licenses, electricity, and cooling have not suddenly become downloadable software. The sales pitch has extended from producing intelligence to installing factories and supervising employees—infrastructure suppliers are now selling the entire value chain packaged together.

Meta's case illustrates another tension. Management attributed advertising revenue growth to AI-improved engagement and recommendation systems, proving that AI can indeed enhance a business that is already profitable. However, quarterly capital expenditure reached $34.9 billion, and free cash flow was negative. As the author wrote: "The existing business helps finance the ambition, while the ambition is getting remarkably good at absorbing the financing."

SpaceX offers a stranger corporate identity. Its AI division (now called SpaceXSI) generated quarterly revenue of $7.56 billion, exceeding Starlink's $5.25 billion, with operating profit of $431 million, yet capital expenditure stood at a staggering $16.44 billion. The author commented: "You can run a rocket company and then discover that the truly expensive expansion project is helping people run software."

Legora represents a different pricing logic. Legal AI software targets not token costs, but the cost of getting work done. The author noted: "A token may be getting cheaper, but a lawyer's afternoon remains a valuable reference price. The investment thesis is that owning the workflow allows you to keep some of the difference. Whether customers or software vendors retain those savings will be an interesting negotiation—presumably involving lawyers."

The bet connecting these announcements is that cheaper inference will expand demand enough to justify more new infrastructure, while specialized applications capture part of the value. The author considers this plausible, but immediately adds a key caveat: it also requires distinguishing between revenue growth and attractive returns on the capital needed to generate that growth. Everyone can have a growth story; they still need to agree on whose margin it is.

This editorial offers no predictions or investment advice. It highlights a structural problem: when efficiency gains are interpreted as justification for expanding spending, readers need to ask where the saved costs ultimately end up—in whose pockets? Are they infrastructure suppliers, application developers, or end users? This question becomes concrete in the face of Meta's negative free cash flow and SpaceX's $16.4 billion capital expenditure, while the gap between Legora's $8.8 billion valuation and its $200 million ARR suggests the answer may depend on who owns the workflow.

Sources

  • thesequence.substack.com↗
Topic

AI推理成本优化

2026年,AI行业重心已从模型训练转向推理成本控制。随着智能体工作流的普及,上下文重发与循环迭代导致Token消耗呈指数级增长,使得推理成本成为基础设施支出的主要驱动因素。OpenAI、Cerebras等厂商通过缓存、分层编排及专用硬件加…

6 steps5 piecesUpdated 2026-10-26 08:43

How it got here

  1. 2026-01-19腾讯云开发者社区文章指出大模型进入“推理成本时代”,推理成本占AI总支出80%以上,vLLM的PagedAttention成为显存管理关键。cloud.tencent.com ↗
  2. 2026-03-01arXiv论文《Token-Budget-Aware Pool Routing》提出基于Token预算的路由策略,在Azure数据集上实现GPU实例减少17-39%,年节省可达数百万美元。arxiv.org ↗
  3. 2026-07-22CoreWeave博客分析智能体工作流成本机制,指出输入Token重发是长尾成本主因,模型分层编排是最强架构级杠杆。wf.coreweave.com ↗

What is still unsettled

  • 廉价推理带来的效率红利最终被云厂商、模型提供商还是应用开发商捕获?
  • 智能体工作流的Token膨胀问题是否会导致新的基础设施泡沫?
  • 开源推理框架(如DeepInfer)与专有云服务在成本优化上的长期竞争力对比如何?

Also in this thread

  • Databricks Co-founder Patrick Wendell: AI Coding Costs Are a Structural Infrastructure Issue; The Routing Layer Will Become the New Battleground2026-10-23
  • CoreWeave Blog: The True Driver of Agent Production Costs is Context Resend in Loops; Architecture Choices Matter More Than Model Selection2026-10-23
Read the full topic →
Continue researching →