ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsTopic · 莱比锡数学基准1 min read·2026-10-06

Leipzig Math Benchmark: Only 1 Unsolved

Next-gen LLMs solved 99 of 100 research-level math questions, nearing expert capability.

ImportanceMaterialEvidenceE2 unreplicatedWrite-upQuick

2026-10-06 12:00 GMT+8

Next-generation large language models have left only one of 100 research-level mathematics questions unsolved in the "Leipzig Benchmark."

The dataset was compiled by 49 mathematicians between April and May 2026 to test AI capabilities on high-difficulty problems with known answers. Earlier evaluation stages showed 41 questions completely unsolved in initial attempts, dropping to 2 after multi-run evaluations and heavy-thinking model interventions.

This update (Stage 4) introduced configurations of next-generation models equipped with web search and code execution. The results indicate that the vast majority of questions are now conquered, suggesting that current frontier models approach human-expert levels in specific structured mathematical reasoning tasks.

Note that these are author-reported results on a small sample size (100 questions), and independent third-party reproduction has not yet been observed.

Sources

  • 原始出处arxiv.org↗
Topic

莱比锡数学基准

莱比锡数学基准(Leipzig Benchmark)是由49位数学家在2026年构建的一套包含100道研究级数学问题的数据集,旨在测试大语言模型(LLM)在复杂推理上的极限。最新数据显示,随着模型迭代,该基准中未解题数已从第一阶段的41题降…

Sign in / Sign up
ReadingResearchRadarInvestment framework
4 steps
1 pieces
Updated 2026-10-08 10:16

How it got here

  1. 2026-04-0149位数学家开始编译100道研究级数学问题,多数工作于5月在莱比锡马克斯·普朗克研究所完成。
  2. 2026-06-04论文v1发布,报告前三阶段评测结果:未解题数从41降至2,显示LLM能力显著提升。
  3. 2026-09-01新增第四阶段评测,下一代模型结合网络搜索和代码执行,将未解题数进一步压缩至1题。

What is still unsettled

  • 剩余的那1道未解题具体是什么?其难度是否代表了当前模型的真正瓶颈?
  • 如何设计基准以彻底排除训练数据污染的影响,从而验证模型的原创推理能力?
Read the full topic →
Continue researching →