ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsTopic · 智能体自我改进1 min read·2026-10-02

New self-distillation method modestly improves computer-use agent training

The method turns execution feedback into step-level training signals; self-reported gains are small and await independent replication.

ImportanceLocalEvidenceE2 unreplicatedWrite-upQuick

2026-10-01 12:00 GMT+8

ComputerSD converts real-time feedback from executed actions into training signals for computer-use agents; its authors report it beats training with outcome rewards only on the OSWorld-Verified benchmark.

The numbers: 1.9 percentage points higher on the Qwen3-VL-8B-Thinking backbone and 4.1 points higher on the specialized EvoCUA-8B, all measured by the paper's own authors.

The gains are modest and the benchmark was run by the authors themselves; whether the method delivers comparable benefits in real use awaits independent replication.

Sources

  • 原始出处arxiv.org↗
Topic

智能体自我改进

智能体自我改进正从理论走向工程落地,核心争议在于“闭环”是否必然导致失控。

5 steps4 piecesUpdated 2026-10-14 01:33

How it got here

  1. 2026-09-22
Sign in / Sign up
ReadingResearchRadarInvestment framework
Weco AI 发布 AIDE²,展示研究智能体通过递归自我改进在8天内发现7次代码优化,并在隐藏评估中保持性能提升。
  • 2026-09-29SelfSearch 论文提交,提出免奖励信号搜索方法,智能体利用过往自我改进记录提升成功率,以4.03美元成本达到 Terminal-Bench 高分。
  • 2026-09-30ComputerSD 论文提交,引入在线自蒸馏方法,将GUI执行反馈转化为逐步训练信号,提升电脑操作智能体在OSWorld上的表现。
  • What is still unsettled

    • 自我改进的收益是否会随着迭代次数增加而出现边际递减,还是像AIDE²所示那样持续泛化?
    • 如何建立有效的机制来检测智能体在自我修改过程中产生的隐性偏差或奖励黑客行为?
    • 当智能体能力超过人类评估周期时,现有的对齐测试标准是否仍然有效?

    Also in this thread

    • OpenAI Researcher Noam Brown Explains Multi-Agent Scaling Limits and Alignment Risks2026-10-13
    • a16z Podcast: MakerMaker.AI Founders Distinguish Recursive Self-Improvement from Automation2026-10-13
    Read the full topic →
    Continue researching →