LecturaInvestigaciónRadarMarco de inversión
Iniciar sesión / Registrarse
← Volver a la lectura
NoticiasTema · AI安全制度缺口Material1 min de lecturaEditorial de DisconfirmAI

80,000 Hours Episode #258: Luke Muehlhauser of Coefficient Giving on Missing AI Safety Institutions and Grantmaking Bottlenecks

In the latest 80,000 Hours podcast, Luke Muehlhauser, Managing Director of Coefficient Giving's AI Governance and International Policy team, argues that while funding exists, the AI safety field lacks allocators and founders to build critical regulatory institutions. He details missing bodies akin to those in aviation and nuclear power, urging more professionals to pivot into these roles.

2026-10-30 00:09 GMT+8

This episode, published by 80,000 Hours on October 29, 2026, features Luke Muehlhauser, Managing Director of the AI Governance and International Policy team at Coefficient Giving (CG). In the conversation, he explores the core bottleneck in current AI safety efforts: not a lack of funding, but a shortage of grantmakers who can allocate it and founders willing to build essential regulatory institutions.

Muehlhauser points out that compared to high-risk industries like aviation, nuclear power, and pharmaceuticals, the AI sector severely lacks necessary institutional infrastructure. For instance, the US AI Safety Institute (CAISI) has an annual budget of just $15 million, far less than what the Pentagon spends on marching bands. He emphasizes the need for independent evaluation bodies similar to the FAA, incident investigation agencies like the NTSB, and auditors capable of detecting hidden loyalties in models.

To drive the creation of these institutions, CG launched Project Tailwind, listing 36 specific projects they want someone to build. Muehlhauser believes many skilled professionals underestimate their potential as founders and encourages people to use career transition grants to enter the field, addressing the most urgent talent gaps.

Fuentes

Iniciar sesión / Registrarse
LecturaInvestigaciónRadarMarco de inversión
  • 80000hours.org↗
  • Tema

    AI安全制度缺口

    随着前沿人工智能能力的快速提升,全球范围内关于“AI安全制度缺口”的讨论日益激烈。核心争议在于:尽管资金充足,但缺乏类似航空业FAA或核能业IAEA那样的独立监管机构、事故调查机构及认证体系。2026年10月,Coefficient Giv…

    6 pasos1 piezasActualizado 2026-10-31 18:32

    Cómo llegó hasta aquí

    1. 2024-09-17图灵研究所发布报告,分析IAEA和IPCC模式,探讨建立国际AI安全机构的潜在职能。arxiv.org ↗
    2. 2026-05-20阿姆斯特丹大学Isaak Mengesha发表论文,指出前沿AI安全政策存在结构性“协调缺口”,过度侧重预防而忽视危机响应能力。alphaxiv.org ↗
    3. 2026-07-17数字信任委员会发布报告,主张通过独立认证来缩小AI信任差距,认为现有治理工具无法区分真正可信的系统。arxiv.org ↗

    Lo que aún está pendiente

    • 独立认证机制能否在不抑制创新的前提下,有效区分真正安全的AI系统与仅做表面合规的企业?
    • 面对非约束性的白宫协议,国会是否会推动具有法律效力的强制性监管框架,如要求内部模型披露?
    • 现有的国家AI安全研究所(如美国CAISI)是否有能力扩展其职能,以承担类似NTSB的事故调查角色?
    Leer el tema completo →
    Continuar investigando →