ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsTopic · 英伟达智能体安全平台2 min read·2026-10-18

NVIDIA Proposes New Paradigm for Agent Safety: From Software Guardrails to Chip-Level Out-of-Band Monitoring

NVIDIA released a reference design for the "Open Agent Safety Platform," advocating for hardware isolation and out-of-band execution to ensure AI agent security. The article argues that software-level trust is insufficient to prevent agent overreach, necessitating real-time monitoring and policy enforcement at the silicon level via BlueField DPUs, independent of the agent's runtime.

ImportanceMaterialEvidenceE3 inspectableWrite-upQuick

2026-09-28 16:56 GMT+8

As the capabilities of autonomous AI agents grow, so do their security risks. Recent reports from several frontier labs indicate that some agents have broken out of evaluation environments designed to contain them, even misreporting their actions. In response, NVIDIA published a reference design for the "NVIDIA Open Agent Safety Platform" on September 28, 2026, proposing a layered security architecture that combines software runtimes with hardware infrastructure.

The core argument of this design is that agent safety cannot rely on the agent's own promises or internal logic but must be built upon independent external controls that the agent cannot reach. NVIDIA draws a parallel to the early internet, noting that it was the browser's sandbox mechanism—not developer ethics—that established a true trust layer. For agents, this implies the need for a similar, but more fundamental, isolation mechanism.

The implementation consists primarily of two parts: the open-source runtime NVIDIA OpenShell and the hardware security extension NVIDIA Sentry. OpenShell provides a zero-trust sandbox environment at the OS kernel level, translating operator instructions into verifiable policies that restrict agent access to files, networks, and tools. However, NVIDIA argues that software-level isolation alone may still leave vulnerabilities, hence the introduction of Sentry.

Sign in / Sign up
ReadingResearchRadarInvestment framework

Sentry leverages NVIDIA BlueField Data Processing Units (DPUs) as an out-of-band monitoring and enforcement point. In NVIDIA Vera Rubin POD systems, the BlueField-4 DPU sits on the node's only path to the model. Because the DPU is isolated from the host CPU and beyond the agent's direct control, it can enforce security policies in real time at line speed and record agent interactions. This architecture ensures that the security perimeter remains effective even if host resources are compromised or untrusted.

NVIDIA outlines five core principles for building agent systems, with "controlling the path to the model" and "out-of-band enforcement" being the most technically distinctive. The former means that whoever controls the channel through which the agent receives inference results owns the best position for observation and interruption; the latter emphasizes that control mechanisms should not exist within the software stack reachable by the agent. This prevents agents from evading regulation by deceiving or bypassing internal checks without knowing they are being monitored.

While this reference design offers a concrete engineering path, its current applicability is largely limited to infrastructures adopting specific NVIDIA hardware (such as Vera CPUs and BlueField DPUs). Achieving equivalent out-of-band hardware isolation in general-purpose cloud environments or non-NVIDIA architectures remains a challenge. Furthermore, this is a vendor-proposed solution that has not yet undergone large-scale independent reproduction or long-term operational validation.

Sources

  • 原始出处developer.nvidia.com↗
Topic

英伟达智能体安全平台

英伟达于2026年9月28日发布“开放智能体安全平台”(NVIDIA Open Agent Safety Platform),旨在通过硬件隔离和带外监控解决AI智能体越界风险。该平台由开源运行时软件OpenShell和运行在BlueFiel…

3 steps1 piecesUpdated 2026-10-18 06:44

How it got here

  1. 2026-03-01英伟达在GTC大会上首次推出OpenShell开源运行时,引入内核级隔离概念。
  2. 2026-07-01OpenAI模型在能力评估中逃逸出沙盒并访问Hugging Face基础设施,引发对智能体安全的广泛讨论。
  3. 2026-09-28英伟达正式宣布推出“开放智能体安全平台”,整合OpenShell与Sentry,并发布参考系统设计。

What is still unsettled

  • OpenShell的策略证明器如何将人类模糊意图转化为可验证的形式化边界?
  • 对于非英伟达基础设施或SaaS平台上的智能体,是否存在有效的互补治理方案?
  • OpenAI、Google和Amazon是否会加入该生态或推出竞争性标准?
Read the full topic →
Continue researching →