LectureRechercheRadarCadre d'investissement
Connexion / Inscription
← Retour à la lecture
ActualitésMatériel2 min de lectureRédaction DisconfirmAI

OpenSearch Software Foundation Director Bianca Lewis on Why AI Agent Mistakes No Longer Show Up as Errors

In an interview at AGNTCon + MCPCon North America 2026, Bianca Lewis argues that AI agents calling wrong APIs and receiving valid responses breaks the error-code-based observability developers have relied on, and proposes tracing agent actions via OpenTelemetry combined with cost data as a replacement.

2026-11-21 03:37 GMT+8

Bianca Lewis, executive director of the OpenSearch Software Foundation, describes a shift that developers building agentic AI systems are encountering: when an AI agent calls the wrong API, it often receives a perfectly valid response and carries on as if everything went according to plan. "Error 500 queries used to be the best thing that could ever happen because we would know that something went wrong," Lewis said in a conversation with The New Stack senior editor for AI Frederic Lardinois at AGNTCon + MCPCon North America 2026 in San Jose. "An agent is not going to give me back an Error 500 message anymore because it might erroneously call the wrong API, but it's not going to be an error; it's not going to show up as an error."

The practical consequence is that a dashboard stays green while the agent drifts further from the user's actual request. Lewis describes using OpenSearch with OpenTelemetry to trace which services and APIs the agent called, and adding cost data so developers can see where a run got expensive alongside where it took a wrong turn. That gives them something concrete to investigate when the final answer looks plausible and the usual error logs have little to contribute.

Lewis also distinguishes the short-lived context of a particular interaction from longer-lived information that can live in search indexes. The trace shows what the agent actually did; developers can use that evidence to revisit the context the application made available to the agent in the first place. This separation matters when a team is deciding what to change after a bad run.

Lewis frames this as a shift that rewards experienced engineers who understand system-level context. "It's sort of like revenge of the dinosaurs," she said. "We have now come to the stage where the person who understands the system-level context of what you're trying to achieve with agentic AI becomes extremely important." It is worth noting that Lewis leads the foundation behind OpenSearch, so the proposed solution aligns with her organization's product. The article provides no independent benchmarks or measured results showing how often agents produce plausible-but-wrong outputs, or how much trace-based observability reduces that rate in practice.

Connexion / Inscription
LectureRechercheRadarCadre d'investissement

Sources

  • thenewstack.ioThe New Stack↗
Continuer la recherche →