LessWrong Author James_Miller: Fear of AI-Inflicted Suffering May Itself Constitute a Material Risk Requiring Prospectus Disclosure
James_Miller argues that under Item 105 of Regulation S-K and the probability-times-magnitude standard from Basic v. Levinson, even if the risk of AI inflicting prolonged suffering never materializes, public fear of it could damage an AI company's value by triggering political and religious opposition—making it a material risk factor that the prospectus must disclose.
Reuters reported that Anthropic's draft prospectus warns of "catastrophic or existential risks to humanity." LessWrong author James_Miller argues that the prospectus also omits a category of risk capable of destroying the company's value: AI subjecting humans to prolonged suffering.
His legal reasoning begins with Item 105 of Regulation S-K, which requires a prospectus to discuss "the material factors that make an investment risky." The U.S. Supreme Court in Basic v. Levinson endorsed weighing an event's probability against its magnitude for the company: even an event with very low probability may constitute material information if its impact is sufficiently large. James_Miller applies this to argue that even if the probability of AI inflicting suffering is extremely low, its potential magnitude—"a billion years of torment"—is enough to cross the materiality threshold.
The key step is that fear itself can cause damage without the catastrophe ever occurring. James_Miller writes, "Public fear of catastrophic suffering could destroy Anthropic's value even if the catastrophe never occurs." He cites the Supreme Court's holding in Matrixx Initiatives v. Siracusano: reports linking a drug to loss of smell could be material even without statistically significant evidence of causation, because regulators sometimes act before causation is proved. By analogy, credible warnings about AI suffering could affect regulation, demand, and financing before the underlying danger is conclusively established.
To illustrate how fear translates into political pressure, James_Miller cites the Pew Research Center's 2023-24 survey finding that 55% of American adults believe in hell. He argues that the prospect of AI creating something resembling hell could mobilize religious opposition and demands for restrictions on AI development and deployment—restrictions that could delay products, increase costs, or prevent profitable uses of the technology.