ServiceNow pipeline turns model failures into agent training data automatically

ServiceNow CoreAI released AutoSynthData on October 2, a pipeline that uses a target model's failures and a stronger teacher's successes to generate training tasks for enterprise agents.

The pipeline first runs diagnostic tasks in the target environment to find capabilities the model repeatedly fails, then generates new system specifications, user prompts and verifiers, executing each candidate in the environment before it enters training. As the model improves, task difficulty follows the remaining gaps.

The team ran experiments in its own EnterpriseOps Gym environment, but the loaded text cuts off before the results section, so no verifiable improvement numbers are available and the gains remain a vendor claim.