독서리서치레이더투자 프레임워크
로그인 / 회원가입
← 읽기로 돌아가기
뉴스간단한 요점1 분 소요DisconfirmAI 편집부

Agent memory evaluation can now quantify accuracy, cost and latency together

DolphinBench requires memory systems to report accuracy, total cost and latency together; it is author-built and worth tracking as a method signal.

2026-09-22 12:00 GMT+8

Readers building agent memory systems now have an evaluation option that puts accuracy, total cost and latency on equal footing: DolphinBench requires all three, with none optional.

Before this, evaluations typically looked only at accuracy, leaving cost and latency unreported and making the real price of a memory method hard to judge.

The benchmark has three knowledge-work personas with roughly 500k tokens of user messages each, and 200 tasks per persona that depend on that history; the authors verified each task by requiring an agent to succeed with the relevant history and fail without it. This is first-party design and verification.

There is no independent reproduction or third-party adoption yet; the preprint material is dated 2026-09-21 and can be tracked as an evaluation option.

출처

  • arxiv.org↗
리서치 계속하기 →
로그인 / 회원가입
독서리서치레이더투자 프레임워크