ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsMaterial2 min readDisconfirmAI Editorial

Google Cloud Launches AI Agent Observability and Governance in BigQuery and Looker

Google Cloud announces new tracking, cost control, and evaluation features for its data platform, aiming to solve transparency and security challenges in enterprise AI agent deployment.

2026-11-14

As enterprises move AI agents from experimental prototypes into production, data and platform teams are discovering that deploying an agent is only half the battle—you also need to see how it reasons, which data it touches, and what it costs to run. On November 14, 2026, Google Cloud announced expanded AI agent observability and evaluation capabilities across its Google Data Cloud, providing unified visibility into first-party data agents in BigQuery and Looker, as well as custom third-party agents built with frameworks like Agent Development Kit (ADK) or LangGraph.

The core of this update is a unified telemetry framework designed to address three operational challenges: tracing multi-step reasoning while protecting sensitive data, controlling token consumption and query spend, and evaluating answer accuracy before prompt or schema changes reach users. For first-party agents, Conversational Analytics agents emit telemetry automatically; for custom agents, developers can stream structured telemetry into BigQuery via single-line SDK instrumentation. All data lands in customer-owned BigQuery tables, ensuring data sovereignty.

In terms of privacy protection, Google Cloud has introduced a 'fail-closed' mechanism. When a knowledge source uses row-level security, column-level policy tags, or dynamic data masking, the system automatically skips logging to prevent sensitive content leakage. Meanwhile, administrators can enable Cloud Monitoring and Cloud Trace to aggregate metrics and trace steps, but these operations exclude core content such as user prompts and model responses by default. If deeper auditing is required, agent owners can opt in to conversation logging on a per-agent basis, inheriting dataset IAM permissions and Customer-Managed Encryption Keys (CMEK).

Sign in / Sign up
ReadingResearchRadarInvestment framework

To control costs, the new tools offer granular token and latency tracking and allow configuration of per-query BigQuery byte scan caps (big_query_max_billed_bytes), using dry-run estimates to block oversized queries and avoid on-demand scan charges. Additionally, daily input/output token quotas at the project, user, or agent level are in preview. These FinOps guardrails enable platform teams to proactively prevent runaway spend as agent adoption grows.

Beyond runtime observability, Google Cloud launched Prism, an open-source evaluation tool that allows testing agents grounded in BigQuery tables or Looker Explores and streaming evaluation results directly into BigQuery for side-by-side analysis with production logs. This integration enables enterprises to verify whether changes to prompts, models, or data schemas improve SQL accuracy and answer quality before deployment, thereby reducing regression risks.

Sources

  • cloud.google.comGoogle Cloud Blog↗
Continue researching →