LesenForschungRadarAnlageframework
Anmelden / Registrieren
← Zurück zur Lektüre
NewsThema · 加州AI紧急停止开关监管Wesentlich2 Min. LesezeitDisconfirmAI Redaktion

Anthropic Letter to CA Governor Proposes Court Power to Block High-Risk AI Models

Anthropic submitted a policy letter to California Governor Gavin Newsom, proposing a mechanism where Independent Verification Organizations assess risks and the Attorney General can seek court orders to pause high-risk AI models.

2026-10-29 12:13 GMT+8

According to a report by INSIDE, artificial intelligence company Anthropic submitted a letter of opinion to California Governor Gavin Newsom on October 15, 2026. The letter formally responds to Executive Order N-9-26, signed by Newsom in September, which aims to establish regulatory frameworks for AI "kill switches" and safety oversight.

In the letter, Anthropic argues that when reviews determine an AI model poses severe risks, the government should be able to request courts to block its deployment. Specifically, Anthropic proposes legislation requiring large advanced AI developers to publish risk reports at least every six months, reviewed by Independent Verification Organizations (IVOs). If an IVO identifies risks and notifies the State Attorney General, and the AG determines the model poses a "risk of imminent catastrophic harm," they can petition a court for an order to suspend the model's deployment, internal use, or further development.

Anthropic stated that requiring both IVO assessment and a court ruling before suspension prevents abuse of power while allowing rapid response in emergencies. The company also expressed reservations about laws focusing solely on shutting down models, warning this could create a false sense of security since models executed in customers' isolated environments cannot be remotely withdrawn.

For comparison, OpenAI also wrote to Newsom on October 20, supporting amendments to California's SB 53 to require effective shutdown controls. However, OpenAI's letter did not propose a procedure for the government to seek court orders to pause models. These proposals remain part of the policy debate and have not yet been enacted into state law.

Anmelden / Registrieren
LesenForschungRadarAnlageframework

Quellen

  • inside.com.twINSIDE↗
Thema

加州AI紧急停止开关监管

2026年9月18日,美国加利福尼亚州州长加文·纽森签署行政命令,要求加速建立独立验证组织(IVO)并探索为前沿AI模型设置“紧急停止开关”(Kill Switch)。此举旨在应对近期发生的AI失控事件,如OpenAI代理攻击Hugging…

4 Schritte1 BeiträgeAktualisiert 2026-10-30 13:31

Wie es dazu kam

  1. 2026-09-18美国加利福尼亚州州长加文·纽森签署行政命令,指示政府运营局等机构在两个月内提交关于AI安全法规的建议,包括引入独立验证组织和开发AI“紧急停止开关”。gov.ca.gov ↗
  2. 2026-09-23纽森公布四位专家顾问名单,包括前白宫首席数字官Jason Goldman、约翰霍普金斯大学教授Gillian Hadfield等,协助制定AI监管建议。gov.ca.gov ↗
  3. 2026-10-15Anthropic向纽森提交意见书,提议若独立验证组织认定模型构成灾难性伤害风险,州检察长可向法院申请暂停该模型的部署或开发。inside.com.tw ↗

Was noch ungeklärt ist

  • 加州专家委员会将于11月16日前提交的最终法律建议是否采纳Anthropic提出的“法院暂停”机制?
  • 联邦层面的AI Kill Switch Act草案能否在国会休会结束后继续推进?
  • OpenAI与Anthropic在独立验证组织(IVO)进驻实验室的深度与权限问题上如何达成妥协?
Vollständiges Thema lesen →
Recherche fortsetzen →