ReadingResearchRadarInvestment frameworkAI Company Primary Sources
Sign in / Sign up
← Back to reading
NewsTopic · AnthropicMaterial2 min readDisconfirmAI Editorial

Anthropic Launches Message Threads to Cut Agent Latency by ~35%

Anthropic has released a public beta of 'message threads' for its Claude Platform, allowing agents to send only new messages instead of full history, reducing Time to First Token (TTFT) by approximately 35% for long contexts.

2026-11-02

Anthropic announced on November 2, 2026, that 'message threads' is now available in public beta on the Claude Platform's Messages API. This feature aims to address the latency issues caused by long-running AI agents needing to resend their entire conversation history on every turn.

In traditional setups, coding or computer-use agents might make hundreds of requests in a single session, each including all previous messages and tool results. Once a conversation reaches hundreds of thousands of tokens, resending this data adds significant time before Claude begins responding. With message threads, agents send only what’s new since the last turn along with the ID of the previous response. Anthropic reports that for requests with 500k to 1M tokens, the median Time to First Token (TTFT) drops by about 35%.

Technically, Anthropic holds each thread in encrypted memory between turns without writing it to disk. A thread expires five minutes after its last request, at which point the client must resend the full conversation to start a new one. Although each request is smaller, Claude still reads the full conversation on every turn, so token usage remains unchanged.

The feature is best suited for active sessions where latency matters, such as long-running coding agents, computer-use agents, and document/image-heavy workflows. Message threads is currently available on the native Claude Platform, Claude Platform on AWS, Claude in Microsoft Foundry, and Claude Models on Google Cloud (Anthropic managed). Standard Claude token rates and existing rate limits apply.

Sources

Sign in / Sign up
ReadingResearchRadarInvestment frameworkAI Company Primary Sources
  • claude.comClaude↗
Topic

Anthropic

Anthropic在Claude平台推出“消息线程”(Message Threads)公开测试版,旨在解决长运行代理因重复发送完整对话历史而导致的延迟问题。该功能允许API在服务器端缓存对话上下文,开发者仅需发送新增消息及上一轮响应ID,从…

2 steps1 piecesUpdated 2026-11-03 08:05

How it got here

  1. 2026-11-02Anthropic发布官方博客,宣布“消息线程”功能进入公开测试阶段,详细说明其通过服务器端缓存减少重复数据传输的技术原理。claude.com ↗
  2. 2026-11-03媒体报道指出,该功能在Claude Code中默认启用,实测显示在长上下文中可将首字生成时间(TTFT)降低约35%,并将中位请求大小从800KB降至1.8KB。x.com ↗

What is still unsettled

  • 消息线程功能何时从公开测试版转为正式可用(GA),以及是否会对其他非Claude Code用户产生额外的计费或限制变化?
  • 在多代理协作系统中,消息线程的服务器端缓存机制如何处理跨代理的上下文一致性与隐私隔离?
  • 对于超过5分钟未活动的线程,客户端自动重放完整对话的逻辑是否会引入新的延迟峰值,实际生产环境中的容错表现如何?
Read the full topic →
Continue researching →