ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsTopic · SE-GoS技能图自进化1 min read·2026-10-02

One round of skill-graph self-evolution lifts retrieval reward from 52.4% to 59.4%

SE-GoS authors' own tests show one evolution round lifting SkillsBench retrieval reward from 52.4% to 59.4%, pending independent replication.

ImportanceLocalEvidenceE2 unreplicatedWrite-upQuick

2026-10-02 12:00 GMT+8

Maintaining a skill retrieval graph from execution traces alone, one round of self-evolution lifts agent skill-library retrieval reward from 52.4% to 59.4% — with no model training, no retrieval-algorithm changes, and no separate model judging which skills relate.

Previous approaches relied on fixed indexing such as full-library loading or vector retrieval, which cannot automatically adjust the graph's connections and node descriptions from execution records.

The SE-GoS authors' own tests show one evolution round lifting average reward on SkillsBench from 52.4% to 59.4%, above full-library loading and vector retrieval baselines; on a held-out split it never saw, from 52.9% to 58.3%, at about two-thirds the input tokens of loading the full library. Repeating the round adds nothing; the abstract does not explain why.

The results are self-reported by the authors with no independent replication yet; the method is by Dawei Fu and four coauthors, updated on arXiv on October 1.

Sources

  • 原始出处arxiv.org↗
Topic

SE-GoS技能图自进化

Sign in / Sign up
ReadingResearchRadarInvestment framework

SE-GoS 是一项让 LLM 智能体的技能检索图从执行轨迹中自我改进的方法:不训练模型、不改技能代码、不换检索算法,只更新图的拓扑、边权和节点描述。作者自测显示,在 1000 技能的 SkillsBench 上,一轮进化把平均奖励从 52…

5 steps1 piecesUpdated 2026-10-03 18:47

How it got here

  1. 2026-04-07Graph-of-Skills(GoS)发布:用类型化技能图加反向 Personalized PageRank 做依赖感知检索,在 SkillsBench 和 ALFWorld 上比全量加载技能平均奖励高 43.6%、token 省 37.8%。但图是静态的,建好后不随执行反馈更新。
  2. 2026-09-08SE-GoS 论文提交(arXiv:2609.08228):从执行轨迹中归纳拓扑、衰减/强化边权、用一轮文本梯度改写检索不佳的节点描述,检索管线本身保持不变。
  3. 2026-09-09Pith 评审给出 3 项主要异议:认可"执行轨迹驱动的图进化"想法干净,但指出摘要夸大了 held-out 迁移结果(论文自报在噪声带内),并质疑通过文件路径识别技能使用会漏掉间接调用。

What is still unsettled

  • held-out 迁移提升(52.9%→58.3%)是否超出噪声带——Pith 认为论文自报结果在噪声带内,摘要存在夸大
  • SE-GoS 能否在独立实验室、不同骨干模型上复现 7 个点的提升
  • 在已知真实依赖结构的合成技能库上,进化后的图是否收敛到真实结构(Pith 提出的判定实验)
Read the full topic →
Continue researching →