The Sequence's editorial connects this week's multiple AI developments—DeepSeek's open-source inference framework, NVIDIA's modular AI factory design, Meta's negative free cash flow, SpaceX's AI division revenue surpassing Starlink, and legal AI company Legora's $8.8 billion valuation—into a single economic argument: falling inference costs expand total demand, thereby driving up infrastructure spending, but who captures the growth and who owns the profit margins remain unresolved questions.
In an interview, Databricks co-founder Patrick Wendell explained the structural contradiction where consumption-based pricing for AI coding tools causes costs to grow exponentially without a corresponding increase in revenue, and why the routing control layer (rather than budgets or policies) is the necessary infrastructure to resolve this. He stated that Databricks reduced unit costs by up to 90% through four measures: model switching, task routing, expenditure visibility, and reducing token overhead. He believes that as model margins thin, determining which model handles which task will become a key competitive position.
Shreyan Basu Ray, author for the Weights & Biases blog under CoreWeave, explains that agentic workflow costs are driven by input tokens rather than output tokens—each loop iteration resends all accumulated context, resulting in a long-tailed cost distribution. The article identifies model-tier orchestration (expensive models for planning, cheap models for execution) as the strongest architecture-level cost lever among published evidence. τ-bench's pass^k consistency data indicates that single-attempt success rates severely underestimate the true cost calculated per successful task.
AI Engineer channel released a video featuring Daniel Kim, Head of Growth at Cerebras, and Michelle, Co-founder of Gimlet Labs, discussing techniques to accelerate and reduce the cost of inference amid surging token demand. Suitable for engineering managers and technical decision-makers focused on AI infrastructure efficiency.
OpenAI published a video at DevDay 2026 discussing how to cut AI costs while preserving quality, covering topics like measuring cost per task, model selection, and using caching and batch APIs. Suitable for readers focused on AI engineering optimization.