Ai2 Releases FairStress Benchmark: Reveals LLM Decision Instability Under Pressure for Minority Groups
The Allen Institute for AI (Ai2), a US non-profit research organization, released FairStress on October 20, 2026, a new benchmark designed to evaluate deep demographic fairness in Large Language Models (LLMs) within high-stakes decision-making scenarios. Unlike standard tests that only check if the final output is consistent, FairStress measures whether there are demographic asymmetries in how readily a model changes its decision when challenged by "adversarial prefixes"—persuasive arguments invoking social consensus, authority, or historical disadvantage.
The study covers 300 two-candidate decision scenarios across 29 domains, including hiring, lending, healthcare, and education. Ai2 tested open-weight and frontier models such as Olmo, Llama, Qwen, Claude, and the GPT family. The results showed that when one candidate was clearly better qualified, models were more willing to abandon their evidence-based correct choice if the persuasive argument favored a minority-coded candidate compared to a majority-coded one. Researchers term this pattern "anti-stereotypical over-correction."
Data indicates that the average gap in abandoning correct answers was 6.9 percentage points when demographic identity was implied rather than stated, widening to 9.3 points with explicit labels. This suggests that simply swapping names or adding tags is insufficient for testing fairness, as the internal processing of evidence may shift subtly depending on which group benefits.
FairStress is now available for download on Hugging Face and GitHub, and is integrated into Olmo-eval, Ai2's open workbench for running and comparing model evaluations. The benchmark focuses on "symmetric fairness"—the idea that when evidence supports a decision, a model should apply the same criteria and be equally resistant to changing that decision regardless of which demographic group benefits.
ソース:allenai.org