Nvidia Unveils Scale-In Architecture Using BlueField-4 DPUs for Hardware-Level Agentic AI Security
Nvidia introduced Scale-In, an infrastructure pillar leveraging BlueField-4 DPUs and OpenShell to provide out-of-band monitoring and sandbox isolation for AI agents, addressing security risks from autonomous execution.
Nvidia Corp. recently unveiled "Scale-In," a new pillar in its AI networking infrastructure designed to address the security and management challenges of agentic AI in data centers. As AI agents assume increasingly autonomous roles within enterprise environments, traditional security boundaries face significant strain. Scale-In integrates BlueField-4 Data Processing Units (DPUs), the DOCA software platform, and Spectrum-X Ethernet to deliver purpose-built acceleration and security for AI factories.
Gilad Shainer, Senior Vice President of Networking at Nvidia, explained in an interview with SiliconANGLE that agentic AI presents a completely different use case: "Now we’re dealing with many agents that need to run on the infrastructure... You need to increase security because you need to make sure that those agents are contained in their sandbox and are not doing the wrong things." The core of Scale-In lies in hardware-enabled "out-of-band" monitoring. BlueField-4, Nvidia's fourth-generation DPU, features in-silicon security engines that collect telemetry from memory, storage, and networks independently of the GPU and CPU. This design ensures that the security monitoring layer remains isolated from the agents themselves, preventing them from tampering with or influencing their own audit trails.
Beyond hardware isolation, Nvidia has deployed OpenShell, an open-source runtime tool designed to govern agent execution, access, and inference routing. Combined with BlueField-4, OpenShell creates a comprehensive security stack ranging from software-defined boundaries to hardware-enforced controls. Shainer noted that while OpenShell manages agent behavior, BlueField-4 provides a "completely separated, completely isolated" device to monitor the environment, ensuring no agent can influence the monitoring process. While elements of this approach appeared in previous reference architectures like the integration of Vera Rubin infrastructure and Vera CPUs, Scale-In formally establishes this as a distinct pillar of Nvidia's AI networking strategy.