Meta Engineering Team Details AI-Native Development Workflow for Forum App: From Human-in-the-Loop to Human-on-the-Loop
Meta engineers share their experience building the standalone Groups app Forum, introducing how they treat AI agents as participants in the development process. By implementing automated validation, simulated user testing, and build isolation, they achieved core feature parity in eight weeks using a 'human-on-the-loop' model.
ImportanceMaterialEvidenceE3 inspectableWrite-upStandard
When building the new standalone Groups app Forum, Meta's engineering team experimented with treating AI agents as participants in the engineering process, rather than just faster code-completion tools. The core shift was moving from 'human-in-the-loop' to 'human-on-the-loop'. In the old mode, engineers drove every step with AI assisting; in the new mode, agents autonomously run iterations of planning, implementation, building, testing, and fixing, while engineers set goals, observe runs, and intervene when deviations occur. This transition required defining success not by lines of code, but by verified, production-ready results.
To enable agents to run safely and autonomously, the team established a standard where verification, not compilation, is the endpoint. A task is only complete when automated tests and visual checks pass. To support this, they implemented four key capabilities: first, treating planning as technical specifications with machine-readable context to reduce ambiguity; second, integrating automated pass/fail signals like build status, unit tests, and UI spec matching directly into the agent loop; third, deploying navigation agents for simulated user testing that interact with live apps like humans and report regressions; and finally, using agentic production operations to assist with root cause analysis post-launch.
The biggest gains came from adapting the environment to the models, not just optimizing prompts. The team prioritized architectural clarity over inherited complexity, choosing modularity so agents could easily plug in. Crucially, they gave agents tools to verify state rather than reasoning based on descriptions. For example, agents can read real-time view hierarchies from simulators, list screen elements, or find paths to target views, significantly reducing erroneous edits. Additionally, independent build variants provided sandbox environments where prototype code was completely excluded from production builds, allowing fast AI iteration while protecting stability.