Bright Data Engineer Yohan Raju Demonstrates How MCP Servers Provide Real-Time Web Data to AI Agents
At the AI Engineer conference, Yohan Raju from Bright Data demonstrated how to use an MCP server to integrate real-time web data, such as Amazon product listings and Reddit discussions, into AI agents. The presentation compared traditional scraping pipelines with agent-based data collection, highlighting the engineering differences in obtaining structured, fresh evidence for decision support.
For engineers building AI agents that require real-time external information, reliably acquiring and structuring web data is a core engineering challenge. In a talk published on October 11, 2026, at the AI Engineer conference, Yohan Raju from Bright Data demonstrated a solution to this problem: using Bright Data's Model Context Protocol (MCP) server as a unified interface to connect real-time web data to AI agent decision flows.
Raju demonstrated a workflow for a product intelligence agent that checks an Amazon listing, searches Reddit for discussion of the same tumbler, and turns both sources into a purchase recommendation. He built this workflow with Bright Data APIs and Gemini, showing why an agent needs fresh, structured evidence rather than relying entirely on information already stored in a model or retrieval system. The demo collected prices, ratings, and product details, added customer sentiment, and then asked the model to explain its recommendation.
Beyond the application demo, Raju delved into the underlying engineering practices. He walked through the work behind a traditional scraping pipeline: discovering pages, handling changing selectors, managing browser and proxy infrastructure, validating returned fields, and delivering clean records downstream. He then compared that process with agent-driven collection, introducing Bright Data's MCP server as an interface to search, page extraction, and browser tools.
The talk included a side-by-side Glassdoor example showing the access problems that can interrupt a seemingly simple request. Raju also discussed job data as another use case, where changes in openings, salaries, and locations require continuous updates alongside historical records. The workshop closed with live notebook results and a discussion of how the same collection and analysis pattern can extend beyond ecommerce.