ElevenLabs Releases Eleven Realtime: Integrated Voice Agent Models Compatible with OpenAI API
In a video introduction, ElevenLabs presented its new Speech-to-Speech model series, Eleven Realtime. The models integrate speech recognition, turn-taking, LLM, and voice generation into a single system to simplify the development of natural voice agents. Official claims state that the v1 Max version scored 98.8% on Artificial Analysis's Big Bench Audio test with an average time-to-speak of 0.57 seconds. Developers can access it via ElevenAgents or through an API compatible with OpenAI's Realtime API.
ImportanceMaterialEvidenceE2 unreplicatedWrite-upQuick
ElevenLabs has introduced Eleven Realtime, a new class of Speech-to-Speech models designed to provide a simpler way to build natural voice agents. According to the official description, each Realtime model is a complete voice agent where speech recognition, turn-taking, LLM, and voice are tuned together as one system. This integration allows developers to obtain a well-performing agent from a single model choice instead of configuring and testing each component individually.
Two models are currently available. Eleven Realtime v1 Mini is built for natural conversation at a low cost, targeting AI assistants, tutors, and interactive characters. Eleven Realtime v1 Max is designed for complex tasks and tool calling, suitable for customer support, lead qualification, and multi-step workflows. Both models start speaking in approximately 0.6 seconds.
Regarding performance metrics, ElevenLabs cites independent evaluation by Artificial Analysis, noting that v1 Max scores 98.8% on Big Bench Audio and starts speaking in 0.57 seconds on average. The company claims that no model on their Speech-to-Speech leaderboard is both faster and more accurate.