독서리서치레이더투자 프레임워크
로그인 / 회원가입
← 읽기로 돌아가기
뉴스중대1 분 소요DisconfirmAI 편집부

Databricks Reports Genie Ontology Outperforms Frontier Agents by 1.6x Accuracy with Half the Tokens

New benchmark developed with Turing shows Databricks' Genie Ontology achieves 91% accuracy on enterprise data tasks, surpassing two leading frontier agents while using less than half the tokens.

2026-11-11 23:00 GMT+8

Big data platform company Databricks released new benchmark results on November 11, 2026, comparing its Genie product—powered by the Genie Ontology context layer—against two major frontier AI agents. The benchmark was developed in collaboration with Turing to evaluate performance on business questions within a live Databricks workspace.

According to the report, Genie achieved a 91% pass rate, compared to 45% and 58% for the two frontier agents. Additionally, Genie used less than half the number of tokens and completed tasks three to four times faster. Databricks attributes this superior performance to Genie Ontology's ability to automatically extract and organize business knowledge from notebooks, dashboards, and SQL queries, providing AI agents with shared enterprise context.

The evaluation utilized a fictional UK energy company scenario, Calderwick Energy, featuring hundreds of tables and complex analytical assets. This marks the first time Databricks has published shareable quantitative benchmark data, addressing previous gaps where claims about Genie One MCP's real-world answer quality lacked specific verification. It is important to note that these results are self-reported by the vendor and have not yet been independently reproduced.

출처

  • databricks.com
로그인 / 회원가입
독서리서치레이더투자 프레임워크
Databricks
↗
리서치 계속하기 →