ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsMaterial3 min readDisconfirmAI Editorial

Prioritizing AI Use Cases: Classify by Type First, Measure Data Distance Next; Model Cost Barely Affects Priority

Johnny Mai, Director of Generative AI Product Strategy at Qwen, states that while 89% of organizations use AI, only 37% report an impact on EBIT. The gap lies not in the model but in backlog prioritization. He proposes a six-type classification, an Impact × Ease 2x2 matrix, and a six-factor weighted scoring system. The core insight is that 'data distance' predicts workload better than model selection—a project to extract invoices costing only $27 per month in tokens may still take two quarters to launch.

Verified 2026-11-10 09:14 GMT+8

89% of organizations use AI in at least one function, yet only 37% report an impact on enterprise EBIT. Johnny Mai, Director of Generative AI Product Strategy and Go-To-Market at Qwen, attributes this gap not to model capability but to backlog prioritization—proposals often rank based on who presented last rather than value. His proposed solution follows four steps: classify by type, plot on a quadrant, score with weights, and then allocate funding.

Six types—Drafters, Answerers, Extractors, Routers, Analysts, and Operators—cover nearly all enterprise AI requests, and the type itself predicts effort before any code is written. Drafters and Routers typically require only a model and a prompt; Operators demand permission management, system integration, and error-handling protocols. A more critical structural insight is that many high-value Operators are composed of lower-tier types. For instance, a procurement approval agent begins as an Extractor (reading the request), becomes a Router (selecting the approval path), acts as an Analyst (checking against budget), and finally operates as an Operator. Funding the component parts first reduces the overall cost of the agent.

Mai identifies 'data distance' as the hidden variable: how far a use case sits from data that is already clean, accessible, and permissioned. He claims this metric predicts effort more reliably than model choice. In the Impact × Ease 2x2 matrix, the vertical axis represents Impact, and the horizontal axis represents Ease (not Effort, so the top-right quadrant signifies 'better'). Each quadrant dictates a specific funding action: High Impact/High Ease projects ship immediately with Q1 metrics; Low Impact/High Ease items receive self-serve access and usage policies to observe organic adoption; High Impact/Low Ease items receive funding to reduce their data distance, with gate review dates set instead of launch dates; Low Impact/Low Ease items are parked with documented reasons for revisit when data or models change. A common error is treating 'Park it' like 'Ship now' by setting a launch date for a project whose data does not yet exist.

Sign in / Sign up
ReadingResearchRadarInvestment framework

Scoring utilizes six weighted criteria: three measuring Impact (Value, Volume, Measurability) and three measuring Ease (Data Readiness, Integration, Error Tolerance), each scored from 1 to 5. Weights must be established before reviewing candidates, as they represent value decisions rather than technical ones. Mai emphasizes that scoring should occur in a room with sponsors, data owners, and engineers present. Disagreement regarding data readiness is often the most valuable output of such meetings, surpassing the utility of final numerical scores.

A worked example illustrates why model cost rarely affects prioritization: assuming 40,000 invoices monthly, with 3,000 input tokens and 500 output tokens per invoice, using qwen3.8-flash in the Singapore region (priced at $0.15 per million input tokens and $0.47 per million output tokens) results in a monthly token cost of approximately $27.40. However, Mai notes that the true workload lies in data readiness and integration, potentially requiring two quarters to launch. His conclusion is to 'price the data distance, not the model.' In the worked example, a procurement approval agent ranks fifth on the weighted total but second on Impact; reading the quadrant before the total prevents misclassifying a 'Park it' item as a 'Ship now' candidate.

The author lists four patterns that should not be funded as originally pitched: Operators lacking underlying Extractors or Routers (effectively funding three disguised projects as one); use cases without baseline metrics (making it impossible to prove impact the following year); projects requiring vendor engineers for continuous operation (Gartner predicts 70% of enterprises will abandon agentic AI built by vendor forward-deployed engineering by 2028); and projects with low data readiness scores (1 or 2) but high enthusiasm. Limitations to note include: this six-type classification and weighting framework is proprietary to the author and not an independently verified industry standard; the article is published by Qwen/Alibaba Cloud, and the worked examples and product recommendations naturally point to its Model Studio platform; while the methodology claims platform neutrality, readers should verify these claims independently.

Sources

  • alibabacloud.comAlibaba Cloud Community↗
Continue researching →