Silicon Valley 101 released Episode 255, titled 'Models Are Getting Stronger, So Why Don't Users Feel It? Revisiting Alibaba International Station President Zhang Kuo,' on October 8, 2026. Hosted by Yiwen, the episode features an in-depth conversation with Zhang Kuo, President of Alibaba International Station, focusing on the challenges and opportunities of deploying AI Agents from general capabilities to vertical business scenarios. Following a previous interview half a year ago about the Accio Work product, this revisit highlights real-world cases of merchants using the tool over the past six months, aiming to answer a core question: How much of the improvement in large model capabilities has actually translated into progress in merchants' work?
In the episode, Zhang Kuo shares a critical observation: although many large models have achieved near-perfect scores on general evaluation leaderboards, his team has not felt a corresponding level of capability improvement in actual business operations. To quantify this gap, the Alibaba International Station team distilled 107 specific tasks from millions of real operational data points on Alibaba.com and Accio Q&A logs. These tasks cover high-frequency commercial activities such as comparing supplier quotes, identifying phishing emails, booking shipping schedules, and handling transaction disputes. According to Zhang, even the most frontier models achieve a task pass rate of only around 61% under conditions of zero human intervention in this specific open-source benchmark. This data intuitively reveals the huge chasm between 'leaderboard scores' and 'actual delivery,' indicating that long-horizon, open-ended business tasks remain a shortcoming of current AI capabilities.
Addressing why AI penetration is extremely high in the Coding field while progress in business scenarios is slow, Zhang analyzes the fundamental differences: code work is inherently 100% digitalized, and results (such as whether it compiles) are immediately verifiable; whereas business tasks involve diverse data sources, lack unified processes, and have long result verification cycles (ranging from days to years), with different enterprises defining 'good results' (profit, scale, or speed) differently. Based on this, he proposes the core formula for building Agents: 'Agent = Model × Harness × Context.' He emphasizes that these three factors are multiplicative; if any one is zero, the whole is invalid. Here, Harness refers to the engineering framework connecting tools and managing memory, while Context refers to the enterprise-specific operational context and data accumulation. This means the competitive barrier for vertical Agents lies not just in the underlying model, but in the deep integration of engineering frameworks and industry knowledge.
Furthermore, the episode discusses the impact of AI on the SaaS industry, cost optimization through multi-model routing (noting that Accio Work reduced costs to one-third of competitors via Pareto-optimal routing), and the boundaries of human judgment retained in the AI era. Zhang believes that while AI can handle a large volume of repetitive work, red lines involving budget allocation, product taste, and final business decisions must still be controlled by humans. For professional readers interested in AI commercialization, vertical domain Agent design, and how SMEs leverage global supply chains to expand their operational radius, this episode provides highly valuable practical perspectives and theoretical frameworks.