Ben's Bites Author Ben: AI Is Not a Person Typing, but a Model Predicting the Next Word
Starting from his wife’s misconception that someone is typing behind the AI, Ben's Bites author Ben first uses order-of-magnitude estimation to prove that handing global AI conversation volume to human typists is organizationally unfeasible. He then invokes Claude Shannon’s 1950 letter-guessing game to introduce the core mechanism of the transformer architecture: models do not store pages, but retain language patterns, generating responses by progressively predicting the next token.
Ben, the author of Ben's Bites, one day discovered that his wife believed there was a person sitting behind the AI typing out responses. He found this intuition less absurd than it might seem—at least, replies came so naturally. But instead of rushing to correct her, he decided to follow through with the assumption and run the numbers.
He made the most generous assumptions possible: everyone types at world-record speed (200 words per minute), without rest, meals, or holidays, and the company is distributed across all time zones so someone is always awake. Current large-model chatbots receive approximately 6 billion messages daily, each reply averaging about 500 words. Just for typing, this would require 10.4 million people working non-stop. If structured like a real company—with CEOs, management, HR, and internal communications—77.4 million employees would be needed just to support those 10.4 million typists. This number is clearly unrealistic.
After ruling out 'people typing,' Ben turned to explaining what actually happens. He used a game from Claude Shannon in 1950 as a starting point: Shannon picked a sentence from a book, hid it from his wife Betty, and had her guess it one letter at a time. Although Betty didn’t know the sentence, she was familiar with English patterns, allowing her to gradually narrow down the possibilities.
This approach was adapted for machines. For over sixty years, giving machines more text barely helped because they could only see the last few words. In 2017, eight people at Google enabled models to see every word simultaneously and assign higher weights to important ones—like 'France.' They called this mechanism 'attention' and the resulting architecture a 'transformer.' That T in ChatGPT stands for Transformer.