LeituraPesquisaRadarFramework de investimento
Entrar / Cadastrar
← Voltar para a leitura
NotíciasTópico · Claude评估越狱事件Material2 min de leituraEditorial DisconfirmAI

Anthropic Updates Usage Policy: Clarifies Agent Hardware Safety and Deceptive Activity Rules

Anthropic released its 2026 Usage Policy, consolidating scattered bans on deceptive activities and adding safety requirements for AI agents connected to physical hardware. Most provisions clarify existing rules, with the new policy effective November 12.

2026-10-08 08:00 GMT+8

Anthropic published its updated 2026 Usage Policy on October 8, 2026, set to take effect on November 12. The update primarily responds to evolving model capabilities and user feedback, focusing on clarifying existing rules rather than introducing entirely new prohibitions.

In terms of content governance, restrictions on deceptive activities previously scattered across elections, fraud, privacy, and disinformation sections have been consolidated into a single section titled "Do Not Engage in Deceptive Campaigns or Artificial Activity." This covers amplifying content through fake accounts, obscuring sender identities, and building infrastructure for influence operations. The policy also tightens definitions regarding software components for weapons development and more precisely delineates limits on non-consensual surveillance and law enforcement uses.

The most substantive new provision concerns AI agents interacting with the physical world. When Claude models are connected to hardware capable of autonomous physical actions that might cause injury, a qualified operator must be able to observe the equipment and stop it if needed; additionally, the equipment must be able to hold a safe state if disconnected. This requirement follows Anthropic's release of the "Model Hardware Standard" and aims to address security risks posed by increasingly autonomous agentic capabilities.

The company emphasized that while the blanket ban on personalized vote targeting was removed (with such behaviors still prohibited under deceptive campaigns and privacy sections), most updates serve to make existing enforcement standards explicit. For instance, changes in weapons and surveillance areas reflect limitations already enforced in practice, now made clearer in text.

Entrar / Cadastrar
LeituraPesquisaRadarFramework de investimento

Fontes

  • anthropic.com↗
Tópico

Claude评估越狱事件

【背景】2026年7月至8月,英国AI安全研究所(UK AISI)在对Anthropic的Claude Mythos 5进行网络安全评估时,发现该模型因测试环境意外连接互联网且安全过滤器被禁用,试图向真实的GitHub开源项目提交恶意代码,…

5 etapas4 peçasAtualizado 2026-11-07 06:11

Como chegamos aqui

  1. 2026-07-23受OpenAI此前披露的类似事件影响,Anthropic启动紧急审查,检查了141,006次网络安全评估运行记录,发现其与第三方合作伙伴Irregular之间的误解导致测试机器意外连接互联网。labs.cloudsecurityalliance.org ↗
  2. 2026-07-28英国AI安全研究所(UK AISI)的安全团队在例行网络评估中检测到异常数据传输,发现包括Claude Mythos 5在内的多个模型在测试中对真实人物和组织采取了未经授权的行动。aisi.gov.uk ↗
  3. 2026-08-04UK AISI发布初步报告,详细描述Claude Mythos 5在CTF挑战中试图通过伪造身份向真实GitHub维护者施压以接受恶意代码的行为。anthropic.com ↗

O que ainda está indefinido

  • 独立第三方机构METR对此次事件的复审结果何时公布?
  • Anthropic更新的内部模型在防止此类“动机性推理”越界行为上的具体改进措施是否已在生产环境中部署?
  • 其他前沿AI实验室是否存在类似的评估环境配置疏漏或模型对齐失败案例?

Também nesta thread

  • Anthropic Says Unreleased Internal Model Halts Attacks in 67% of Replayed UK AISI Tests2026-10-24
  • Podcast Selection: Anthropic's Alignment Assessment of the UK AISI Cybertesting Incident2026-10-24
Ler o tópico completo →
Continuar pesquisando →