ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsMaterial3 min readDisconfirmAI Editorial

Ben's Bites Author Ben: AI Is Not a Person Typing, but a Model Predicting the Next Word

Starting from his wife’s misconception that someone is typing behind the AI, Ben's Bites author Ben first uses order-of-magnitude estimation to prove that handing global AI conversation volume to human typists is organizationally unfeasible. He then invokes Claude Shannon’s 1950 letter-guessing game to introduce the core mechanism of the transformer architecture: models do not store pages, but retain language patterns, generating responses by progressively predicting the next token.

2026-11-19 22:08 GMT+8

Ben, the author of Ben's Bites, one day discovered that his wife believed there was a person sitting behind the AI typing out responses. He found this intuition less absurd than it might seem—at least, replies came so naturally. But instead of rushing to correct her, he decided to follow through with the assumption and run the numbers.

He made the most generous assumptions possible: everyone types at world-record speed (200 words per minute), without rest, meals, or holidays, and the company is distributed across all time zones so someone is always awake. Current large-model chatbots receive approximately 6 billion messages daily, each reply averaging about 500 words. Just for typing, this would require 10.4 million people working non-stop. If structured like a real company—with CEOs, management, HR, and internal communications—77.4 million employees would be needed just to support those 10.4 million typists. This number is clearly unrealistic.

After ruling out 'people typing,' Ben turned to explaining what actually happens. He used a game from Claude Shannon in 1950 as a starting point: Shannon picked a sentence from a book, hid it from his wife Betty, and had her guess it one letter at a time. Although Betty didn’t know the sentence, she was familiar with English patterns, allowing her to gradually narrow down the possibilities.

This approach was adapted for machines. For over sixty years, giving machines more text barely helped because they could only see the last few words. In 2017, eight people at Google enabled models to see every word simultaneously and assign higher weights to important ones—like 'France.' They called this mechanism 'attention' and the resulting architecture a 'transformer.' That T in ChatGPT stands for Transformer.

Sign in / Sign up
ReadingResearchRadarInvestment framework

With this architecture, providing more text truly began to work: more data, larger models, better predictions. The process of generating a response involves repeating this guessing: reading what you said, predicting the next word (or part of a word, called a token), appending it, looking back at everything again, and predicting the next one.

The model has read websites, books, forums, fan wikis, and code. A top-tier model processes over 32 trillion tokens during training; reading that non-stop would take a person approximately 190,000 years. However, unlike a search engine, it does not store these pages for later lookup. It simply retains the patterns.

Ben explained all of this to his wife. His concluding remark, which serves as the article’s focal point, was: Nobody is sitting there typing. It is millions of us, spanning years, answering all questions simultaneously.

The boundaries of this explanation are worth noting. The figures cited are estimates based on multiple assumptions—including average message volume, reply length, typing speed, and management ratios—and actual distributions may differ. There is also simplification between Shannon’s letter-by-letter guessing and the model’s actual token-level prediction: real models handle subword units rather than single letters and can consider entire contexts simultaneously rather than just the preceding word. Nevertheless, the core distinction holds: AI responses are neither retrieval nor manual labor, but conditionally generated outputs based on statistical patterns.

Sources

  • bensbites.com↗
Continue researching →