Datadog AI Vulnerability Hunting
2 steps1 pieces4 Sources
Datadog, the New York-based monitoring company, has detailed an agentic vulnerability hunting system designed to overcome the limitations of AI in identifying exploitable security flaws. While current closed- and open-weight models can find potential vulnerabilities through skills or prompting, determining whether these issues are actually exploitable requires understanding a service’s business logic and existing security controls—context often missing from single-repository analysis.
To address this, Datadog built an orchestration pipeline that utilizes "threat packs." These are compact, human-reviewed documents (approximately 300 lines) that encode subject matter experts’ security knowledge into explicit requirements and unbreakable invariants. The pipeline loads this context, clones relevant repositories, and splits the workflow into separate tasks for vulnerability discovery and reproduction, routing each to the most cost-effective model capable of completing it.
The system has already yielded results: hunts using these packs uncovered guest-to-host escapes in open-source components, specifically one via virtio-fs in Kata Containers’ Rust runtime and another due to missing length validation in Dragonball’s virtio-blk implementation. To ensure reliability, Datadog repeats hunts against known vulnerabilities to test consistency after model or harness changes. An initial benchmark from August 2026 involved 43 validated vulnerabilities across nine threat packs, tracking both union detection and stable detection rates.
This approach matters because it shifts the focus from making AI "smarter" to providing it with structured, versioned security context. By encoding human knowledge as invariants, Datadog reduces noise and improves report quality, allowing agents to distinguish between false positives and genuine breaches of trust boundaries. Future steps include moving from finding flaws to testing proposed fixes against these same security requirements.
How it got here
Nov 18, 2026: Datadog Security Engineering team publishes details on their agentic vulnerability hunting system, introducing 'threat packs' to provide AI agents with necessary security context.