ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
News3 min read·2026-10-21DisconfirmAI Editorial

Why DeepSeek's Liang Wenfeng Rarely Signs Flagship Model Reports, Only Foundational Technique Papers

Lei Feng Net author Gao Yunyi surveyed the 11 papers Liang Wenfeng signed over the past three years, finding he consistently appears on foundational technique papers—MoE routing, attention mechanisms, network topology, inference operators, and sandbox infrastructure—while rarely appearing on flagship model reports that carry over a hundred author names. This signing pattern points to a coherent technical route: attacking cost and efficiency bottlenecks at the architectural substrate, rather than chasing model scale.

ImportanceMaterialEvidenceE3 inspectableWrite-upQuick

Original publication time 2026-09-25 18:48 GMT+8

Over the past three years, DeepSeek has released multiple flagship models, each technical report carrying over a hundred author names. But look at the author lists and you find an interesting pattern: Liang Wenfeng's name rarely appears on V3.2, V4, or V4.1-Flash reports. Instead, he consistently appears on a different class of papers—MLA attention mechanism, MoE routing strategy, mHC network topology, DSpark inference scheduling, and DSec sandbox infrastructure. These are the atomic technical units that constitute model capability, not the models themselves.

Lei Feng Net author Gao Yunyi compiled this observation into an article, calling it a technical sniping route, and counted the 11 foundational papers Liang Wenfeng signed. The signing pattern itself is verifiable: check the author lists on arXiv. What it reveals is that Liang Wenfeng's personal focus is not training a larger model but finding the deepest bottleneck that makes a model cheaper or stronger.

Take MLA (Multi-head Latent Attention) as an example. When large models process long text, they must cache massive key-value pairs (KV Cache), which directly determines memory usage and speed during inference. MLA's approach is to compress this cache with low-rank vectors, reducing KV Cache volume by approximately 93.3%. This is not optimization at the model level but a redesign of the data structure for one specific component within the attention mechanism. Similarly, MoE routing solves the scheduling problem of which experts each token should invoke; NSA solves the memory-access problem of how to align sparse computation with GPU hardware circuits; mHC solves the topological constraint problem of whether numerical stability will collapse during very deep network training.

Sign in / Sign up
ReadingResearchRadarInvestment framework

These papers share a common characteristic: they attack foundational bottlenecks that the industry acknowledges but has not effectively solved, and their solutions land at the architecture or mathematics level, not the data-volume or compute-investment level. Gao Yunyi cites a comparison in the article: OpenAI's GPT-4-class model training costs hundreds of millions of dollars, while the DeepSeek-V3 team reported completing training on 2,048 H800 GPUs for approximately $5.6 million. The article also relays SemiAnalysis's caveat—that the $5.6 million is merely the direct electricity bill for pure GPU training, excluding R&D losses, hardware depreciation, and total infrastructure investment. But even with the corrected scope, the order-of-magnitude difference still holds, and its source is precisely the foundational architectural choices described above.

However, what the signing pattern can prove requires caution. Liang Wenfeng's choice to sign foundational papers rather than model reports may reflect personal research preference, or it may be a natural distribution of authorship contribution—foundational technique papers have fewer authors, model reports have more. Gao Yunyi interprets it as a conscious sniping strategy, which is a reasonable inference but not a proof. What actually supports this inference is that these foundational choices repeatedly hit industry bottlenecks and produced verifiable efficiency gains, not the signing behavior itself.

For readers, the practical value of this observation is that it reduces DeepSeek's cost-performance label to a traceable technical route. If you care about AI infrastructure or model training efficiency, what deserves attention is not the parameter count of the next large model, but the next foundational bottleneck to be conquered—attention data structures, expert scheduling, network topology constraints, inference compute-memory access alignment, and agent training environment isolation. Liang Wenfeng's signing pattern at least suggests: someone has been consistently working in these directions.

Sources

  • 原始出处leiphone.com↗
Continue researching →