Apple's probe guidance steers diffusion language models without an extra forward pass

Readers can now learn of a way to guide diffusion language models without adding inference cost: probe guidance, introduced by Apple's machine learning research team, builds a guidance signal from the frozen internal states of an existing diffusion model, eliminating the extra inference forward pass that autoguidance requires, and the team says that applied to a 1.7B diffusion language model it consistently improves multiple-choice question answering benchmarks.

Previously, autoguidance required an extra forward pass and had lacked an account of why it works.

The team reports the method sets a new state of the art on unconditional generation for continuous diffusion language models. These results are first-party benchmarks.

The work also reports a mechanism finding: the weak model in autoguidance must come from a low-entropy region of training. If it holds, this may be more useful for diffusion language model research than any single benchmark number. The results have not been independently reproduced and come from a paper submitted on 2026-09-23.