METR's Q4 2026 Update: Why AI Capability Measurement Is Getting Harder Even as Progress Accelerates
METR's latest capability evaluation introduces Lifecycle Cost as a rough proxy for how difficult a task is to turn into an RL training environment, finds time horizons doubling roughly every 3.6 months on the combined task suite, and argues current public evidence cannot rule out drastic AI R&D acceleration in the next couple of years.
METR's Q4 2026 capability update makes a deliberately hedged argument: current public evidence is insufficient to rule out drastic AI R&D acceleration in the next couple of years. By drastic acceleration they mean a situation where capabilities improve so quickly that humans can no longer meaningfully understand, assess, and react to catastrophic risks posed by new AI systems. The report evaluates models up to Opus 5.5 and GPT-6 Astra, and its central methodological innovation is a new metric called Lifecycle Cost, created to quantify how difficult a task is to make into an RL environment.
The headline progress finding is that time horizons—the length of task an agent can complete with 50% success rate, measured against human completion time—are doubling roughly every 3.6 months across their combined TH1.1 and TH2 suites. On verifiable tasks like coding and optimization, current frontier models typically match or outperform the skilled human baseliners METR recruited. In one revealing example, on Al Zimmermann's programming contests (multi-month optimization competitions with 97 to 413 human participants), the median placement of the strongest models was the 96th to 98th percentile, though roughly 4 humans still beat them in the median contest. On Budget NanoGPT speedrun, the best agent run achieved a 15.7% speedup in 48 hours, while a top human contributor with AI assistance estimated 60 hours for a 41% speedup.
The Lifecycle Cost concept adds the most explanatory value for readers. METR defines it as the estimated cost to develop a containerized environment for a task and then run and score it 100 times. The intuition is that properties making an evaluation more realistic—requiring manual scoring, long feedback loops, specialized infrastructure—also make it costlier to turn into an RL training environment. Models perform worse on higher Lifecycle Cost tasks even after controlling for how long humans take to complete them. In their data, a doubling of Lifecycle Cost for a task of a given length imposes a difficulty penalty very roughly equivalent to halving the agent's time horizon. However, METR is explicit that this is a rough proxy calibrated to their own constraints, and that the link between Lifecycle Cost and actual realism remains very unclear.