Eye on A.I. Podcast: Ilya Sutskever on LLM Understanding, Hallucinations, and AI in Democracy
In a recent episode of Eye on A.I., host Craig Smith interviews Ilya Sutskever, Co-Founder and Chief Scientist at Safe Superintelligence Inc. and former chief scientist at OpenAI. The conversation covers Sutskever's arguments that large language models develop true understanding through prediction at scale, his optimistic view on solving hallucinations via RLHF, and a novel vision for AI enabling more granular political participation.
Eye on A.I. podcast released an episode on October 9, 2026, featuring Ilya Sutskever, currently Co-Founder and Chief Scientist at Safe Superintelligence Inc. and formerly the chief scientist at OpenAI where he was one of the primary minds behind GPT-3 and GPT-4. Hosted by Craig Smith, this interview delves into the intellectual history of deep learning and addresses some of the most pressing current questions in AI.
According to the official show notes, Sutskever challenges the common critique that large language models merely learn statistical patterns. He argues that to predict text well—essentially to compress it—a model must develop an understanding of the underlying processes that produced that data. As models improve, he suggests this understanding will reach a "shocking degree," citing the Bing/Sydney incident as evidence that psychological language is already an appropriate frame for describing what these systems have internalized.
On the topic of hallucinations, the show notes describe Sutskever as precise and unusually optimistic. He distinguishes between pre-training objectives, which produce rich world knowledge but optimize for statistical plausibility rather than accuracy, and Reinforcement Learning from Human Feedback (RLHF), which directly teaches models to update away from outputs flagged as wrong. His assessment, per the notes, is that there is a "quite a high chance" of solving hallucinations completely.
The conversation also touches on the transition to transformer architectures, critiques Rich Sutton's "bitter lesson" regarding pure scaling, and presents a surprising vision for AI's role in democracy. Sutskever proposes that citizens might use high-bandwidth interactions with AI to specify their values directly, potentially enabling a form of political participation more granular than voting alone. This episode offers a unique window into the thinking of a key figure in modern AI development, though readers should note that these points are drawn from publisher summaries rather than a full transcript.