Optiver Head of AI Engineering Noyan Tokgozoglu Discusses Rapid Model Deployment and Cost Control in High-Frequency Trading
In a recent podcast, Noyan Tokgozoglu, Head of AI Engineering at Dutch market maker Optiver, outlined the company's internal AI platform architecture, focusing on achieving same-day deployment of new frontier models through an inference gateway and meta-harness, while regaining control over AI spending after major summer model releases.
Noyan Tokgozoglu, Head of AI Engineering at Dutch market maker Optiver, recently participated in a podcast interview discussing AI engineering practices. The episode focuses on how Optiver balances the extreme speed requirements of high-frequency trading with the need to manage rapid iteration and cost constraints within its internal AI infrastructure.
According to the episode description, Tokgozoglu detailed the core components of Optiver's on-premises AI platform. This includes an inference gateway for routing and budgeting, a process for benchmarking new frontier models against internal golden sets to enable same-day adoption, and a "meta harness" that is agnostic to specific models and testing frameworks. He also shared insights on how the company regained control over AI spending following a series of major large-model releases during the summer.
For readers interested in AI infrastructure investment, this resource offers a specific first-hand perspective on how enterprises in highly sensitive financial environments balance model update velocity with operational costs through architectural design. While a full transcript is unavailable to verify specific technical details, the direct statement from a technology leader at a leading market maker provides clear industry reference value regarding the mentioned architectural patterns.