ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsMaterial4 min readDisconfirmAI Editorial

Tencent Hy4 Flash Four-Wheel Real-World Test: Affordability and Speed Become the New Agent Era Agenda

GeekPark conducted four comparative tests of Hy4 Flash against DeepSeek-V4.1-Flash and the original Hy4. The Flash model completed office decision-making tasks in one-third the time of its competitors, with a single-task cost approximately one-twentieth that of Hy4, while output quality approached SOTA levels; however, it still exhibited misinterpretations in complex visual reasoning.

2026-11-17 15:12 GMT+8

Before 2026, whether a model would trend often depended on what new capabilities it had achieved. GPT-4o's real-time voice interaction, Claude's coding ability, and DeepSeek R1's reasoning performance once took turns becoming the focus of discussion. But by 2026, after Agents truly became popular, the wind changed. The leading capabilities of SOTA models were refreshed quarter by quarter, becoming no longer novel. Instead, whether model capabilities could be afforded and waited for became the new agenda.

This shift is supported by specific numbers. OpenRouter disclosed that on February 6 this year, Agent token usage on its platform exceeded human direct calls for the first time; by the end of September, it was already about seven times that of humans. A study by the University of Michigan and Stanford University covering 8 models and 500 real-world code problems found that in their testing, each attempt by an Agent to process a problem consumed an average cumulative total of about 4.17 million tokens, with model invocation costs of approximately $1.86. At this average, running ten times consecutively approaches $20. The longer the task, the more sensitive users are to speed and price.

After Tencent released Hy4 Flash, GeekPark obtained early access qualifications and placed it into WorkBuddy, conducting four rounds of comparison against similarly positioned DeepSeek-V4.1-Flash (version 1017) and the original Hy4: office decision-making, visual understanding, code repair, and PPT generation.

In the first round, office decision-making, the model was asked to prepare decisions for a product launch event, with intentionally contradictory data formats inserted into the materials. Hy4 Flash took 1 minute and 14 seconds, while DeepSeek-V4.1-Flash took 4 minutes and 8 seconds. Both reached consistent core judgments—both recommended a compromise release, adopting stricter figures, and not opening registration on-site—and delivered the requested one-page summary, with no significant difference in quality. In this round of testing, Hy4 Flash's advantage lay mainly in speed, completing the task in only about one-third of the competitor's time.

Sign in / Sign up
ReadingResearchRadarInvestment framework

In the second round, visual understanding, the same contradictory information was processed into a projection image, asking the model to make judgments based solely on the image. This round showed divergence: DeepSeek-V4.1-Flash took 1 minute and 25 seconds, faster than Hy4 Flash's 2 minutes and 46 seconds, but made two clear misjudgments—reading the 'billable revenue' red label as 'non-paid,' and claiming the bar chart proportions were self-consistent while ignoring the error in the actual drawn height. Although Hy4 Flash was nearly twice as slow, it correctly identified the conflict that '6 prospective clients were labeled as billable revenue, but only 1 confirmed payment,' resulting in higher overall accuracy.

In the third round, code repair, the model was tasked with taking over an inventory and pricing project with four existing online bugs, finding the issues itself, writing reproduction tests, and fixing the code. Hy4 Flash took 2 minutes and 5 seconds, finding and fixing all four issues, adding 5 new tests to complete end-to-end verification. The official version of Hy4 took 3 minutes and 49 seconds; the root causes and fixes were almost identical, but it added 8 new tests, making the process more complete. Their core results were close, with the difference lying in speed and the breadth of test coverage.

In the fourth round, PPT generation, an OpticalRAG technical paper was converted into explainable slides. Hy4 Flash took 9 minutes and 5 seconds to generate 21 pages, addressing problems, methods, experiments, and limitations as required, with key figures accurate. The official version of Hy4 took 15 minutes and 47 seconds, producing 18 pages; the structure and figures were also correct, but the pages were more suitable for direct presentation, and the analysis of conclusions was explained more clearly.

Synthesizing the four rounds of testing, the Flash model has already reached the level of professional engineers and white-collar workers in daily office and code repair tasks. Its cost is not a significant lack of capability, but rather a slightly higher misinterpretation rate in specific scenarios (such as complex visual reasoning) and gaps in output refinement. For Agent scenarios characterized by multiple invocation rounds, ultra-long context, and easily out-of-control costs, using Flash models to handle most daily tasks and calling SOTA models only for complex links like long-term software engineering is a pragmatic division of labor.

It needs to be pointed out that these tests were designed by GeekPark editors; the coverage of the four scenarios is limited, and task difficulty and evaluation criteria were subjectively set by the editors. They provide useful directional sense but cannot replace large-scale, multi-scenario independent evaluations.

Sources

  • geekpark.netGeekPark↗
Continue researching →