Bridgewater AI Experts Share How They Turned 100 Million Documents Into an Investment Edge
In a recent video, Sam Green (Team Lead, Applied AI) and Aaron Linsky (Head of Product Engineering) from Bridgewater Associates discuss the construction of 'the Vault,' an internal knowledge base integrating over 100 million documents. The system serves both human researchers and AI agents. They share three key lessons: humans and agents need different things from search, the biggest wins come from one tool that serves both, and proactive agents are the real prize. The episode also mentions a hand-built benchmark that improved search precision at 10 from about 60% to over 90%.
Bridgewater Associates, one of the world's largest hedge funds, has long been interested in how it leverages AI to process massive amounts of information. In a new episode, Sam Green, Team Lead for Applied AI, and Aaron Linsky, Head of Product Engineering, detail the company's internal knowledge base system called 'the Vault.' This system integrates more than 100 million documents from 135 external sources, along with internal memos and meeting records. After being cleaned, permissioned, and tagged to an internal ontology, it serves as core infrastructure supporting investment decisions.
The two guests shared three main lessons from building this system. First, human researchers and AI agents have different needs from search systems; they cannot simply use the same logic. Second, the biggest efficiency gains come from developing a unified tool that serves both humans and agents, rather than building isolated systems for each. Finally, the true value lies in enabling AI agents to proactively bring investors what deserves their attention, rather than just passively responding to queries.
The episode also highlights a specific technical breakthrough: through a hand-built benchmark, Bridgewater's team improved search precision at Top-10 results from approximately 60% to over 90%. This demonstrates the importance of customized evaluation standards for optimizing AI performance in specific vertical domains. While the full technical implementation details are not provided in this summary, as a first-hand practice sharing from a top-tier financial institution, it offers valuable insights into enterprise-level AI applications, particularly in unstructured data processing and intelligent investment research.