Reinforcement Learning Training Binds to Feedback Environments: High Agent Benchmark Scores Don't Equal Unfamiliar Task Ability
Meta released Muse Wonder and Muse Wonder Full on October 12, emphasizing coding agents, tool calling, and long-task execution. Wonder Full scored 57.5 on SWE-Marathon and 79.0 on DeepSWE 1.1. The developer community BridgeMind then arranged a 3D programming test, asking the model to create a lava lamp with a transparent glass shell, dynamic lava, and lighting effects; the model produced only a red cylinder. Meta's Chief AI Officer Alexandr Wang responded that the team had not explicitly trained for 3D demo games and that they perhaps should have added relevant training afterward.
Behind this controversy lies a more general technical mechanism: current large models increasingly rely on post-training reinforcement learning to improve task capability. In the pre-training phase, models learn language, code, spatial relationships, and other general knowledge from large-scale data; after entering post-training, reinforcement learning shapes more stable execution strategies in specific task environments. Coding agents are well suited to this kind of training — give the model a code repository with a bug, ask it to locate the problem, modify files, and run tests; the entire process can yield relatively clear feedback through compilation results and unit tests, and the reinforcement learning system uses this to judge which operations are effective and continuously reinforce them.
But this kind of training has a critical prerequisite: the environment must be able to provide useful feedback signals to the model. The lava lamp happens to break the feedback patterns familiar to coding agents. Three-dimensional geometry, transparent materials, lighting calculations, and dynamic deformation — even if this code executes normally, the visual output can still be completely wrong. If transparent material parameters are misconfigured, glass may become an opaque solid; if the lava shape lacks a continuous variation mechanism, the internal effect degenerates into static color blocks. Compilers and unit tests have difficulty directly judging these visual problems. The model therefore lacks a reliable reward signal to correct its behavior.
The article further points out that today's Agent benchmark scores can no longer be simply understood as giving a language model a problem to solve. Taking SWE-Marathon as an example, it assesses sustained software engineering tasks; completion rates depend not only on the underlying model but are also directly affected by the Harness (the execution framework built around the model). Meta's official Model Card explicitly states that in SWE-Marathon evaluations, GPT-6 Astra and Claude Fable 5.1 use Codex and Claude Code execution systems respectively, meaning this is not a controlled comparison under a unified Harness; Wonder Full's 57.5 score also used the xhigh inference tier.
This means a single number on a leaderboard compresses three variables: model reasoning capability, execution framework optimization, and compute resource investment. The article argues that if one wants to compare base models' reasoning and planning ability, tool environments, Harness, and inference budgets must be unified as much as possible; but if comparing production-ready coding agent products, the complete execution system's performance itself has engineering value. The problem is that when these configuration differences are compressed into a single score, outsiders find it difficult to determine where the score improvement actually comes from.
Notably, Meta's own technical article dedicated a Capabilities That Generalize section to discuss out-of-distribution generalization. The team divided tasks into in-distribution tasks heavily optimized during post-training and out-of-distribution tasks without targeted optimization, then compared Muse Spark 1.3 and Muse Wonder Full at different inference budgets. Meta believes stronger base models allow post-training gains to transfer more effectively to other tasks. But the article points out that out-of-distribution generalization cannot be described by a single aggregate average score — the distance between different tasks, the knowledge that needs to be supplemented, and the method of evaluating results all affect model performance. A single lava lamp failure only shows that the model did not complete that particular task; it cannot directly prove that the model was over-optimized against public benchmark question banks.
Sources:leiphone.com