Chenyu Zhao, co-founder of Fireworks AI, presented a concrete financial threshold for enterprise AI expenditure at the Slush startup conference in Helsinki, Finland: when user scale exceeds 10,000 to 100,000 and monthly token spending reaches $10,000 to $100,000, it is time to seriously consider switching from frontier models to open-source models. His core argument is not that open-source models have caught up to frontier models in capability, but that most enterprise workloads do not require the general intelligence level provided by frontier models.
Zhao described the future landscape as a 'two-model world': frontier models are used for high-level planning and complex reasoning, while open-source models handle daily execution, operating in parallel. The key mechanism connecting them is routing—assigning tasks to the most suitable model based on cost rather than per-token unit price. He stated that the industry is no longer focused on the cost per token, but on the total cost to complete a single task. This distinction has practical implications for enterprises: an open-source model may have a lower unit price, but if it requires more tokens to complete a task, the total cost might not be lower; conversely, a frontier model with a higher unit price might be cheaper overall if it completes the task in one go.
Zhao’s premise is that the capability gap between open-source and frontier models is currently at most six months, and likely closer to three. He noted that a wave of excellent open-source models emerged following DeepSeek, significantly narrowing the gap from what was once one to one-and-a-half years. However, this assessment comes from his own evaluation and is not independently measured. Notably, Anthropic released Opus 5.5 in September, which reduced costs for typical workloads by 40%, lowering input and output token prices to $4 and $20 per million, respectively, and cache reads to $0.20 per million. As frontier models themselves continue to drop in price, Zhao’s suggested switching threshold may shift upward over time.
Zhao’s framework carries a conflict of interest that readers must evaluate: Fireworks’ business is precisely helping enterprises fine-tune open-source models on their own data and host them. Its customers include Uber, Shopify, and Notion. In autumn, Fireworks disclosed two security incidents where hackers accessed customer data through its cloud provider; Notion subsequently disconnected from the service, and Uber reported that personal information for approximately 150,000 drivers was stolen. Zhao acknowledged these incidents and stated that the company is migrating batch prediction services to online processes to reduce data retention times. While these accidents do not affect the logic of his cost framework, they impact whether enterprises are willing to entrust their data to intermediary platforms like Fireworks.
In summary, Zhao’s proposed routing framework for a two-model world is an actionable decision-making tool: first evaluate based on task cost rather than per-token unit price, then decide whether to introduce open-source models based on expenditure scale. However, its premise—that the open-source model gap is only three to six months—is Zhao’s judgment rather than independent verification, and continued price cuts by frontier models may alter the economics of switching. Enterprises adopting this framework need to measure task-level costs themselves rather than directly applying his thresholds.