OpenAI Performance Factory
3 steps1 pieces3 Sources
OpenAI has deployed the "Performance Factory," an internal autonomous system powered by Codex that automates the investigation and mitigation of performance regressions in ChatGPT. The system addresses a critical bottleneck: as AI agents accelerate code changes, manual performance review becomes unsustainable. In just over three months, its first workflow, the Regression Workflow, tracked more than 1,700 investigations and identified root causes for over 600 cases, averaging 17 automated investigations per day.
The factory operates through four components: a task service with configurable workflows, a dispatch loop assigning work to agents, cloud-based Codex execution, and event subscriptions that wake agents when conditions change (e.g., GitHub reviews or deployments). A key innovation is the use of independent adversarial agents to rebut initial diagnoses, improving accuracy. However, while diagnosis is automated, fixes remain harder to implement; only about 15 shipped fixes were exact pull requests authored by Codex, with engineers still reviewing and merging most changes. OpenAI reports a 70% root-cause accuracy rate in manual assessments, but emphasizes that architectural tradeoffs and final deployment decisions require human judgment.
How it got here
November 19, 2026: OpenAI engineers Okay Zed and Cyrus Forbes publish an engineering post detailing the Performance Factory, describing its evolution from manual tools to automated Codex workflows.
openai.com ↗November 19, 2026: VentureBeat releases an exclusive report on the system, highlighting metrics such as 1,700+ investigations and 600+ root causes identified in three months.
venturebeat.com ↗