Visual error-spotting jumps from 28% to 80% in ten months, still far from real-time
Assembly-error detection is improving fast, but at roughly three minutes per photo it is not yet usable for real-time guidance.
ImportanceLocalEvidenceE2 unreplicatedWrite-upQuick
Epoch AI's Furniture Assembly Benchmark shows models' accuracy at spotting mis-assembled IKEA furniture rising from 28% to 80% in ten months.
The benchmark has models compare photos of three furniture pieces against instructions and identify deliberate errors. In November 2025 the best model, Claude Opus 4.5, scored 28%; OpenAI's GPT-6 Astra now hits 80%, with Anthropic's Claude Fable 5.1 next at 70%.
The limit is speed: Astra takes about three minutes per photo, and Epoch AI says that is not yet fast enough for real-time assembly guidance. Chinese open-weight models such as Kimi K3 trail the leaders by at least seven months.