LeituraPesquisaRadarFramework de investimento
Entrar / Cadastrar
← Voltar para a leitura
NotíciasTópico · NTM归一化轨迹模型Material2 min de leituraEditorial DisconfirmAI

NTM: Replacing Gaussian Assumptions with Normalizing Flows, Four-Step Image Generation Retains Exact Likelihood

In a paper accepted at NeurIPS 2026, the Apple Machine Learning Research team proposes Normalizing Trajectory Models (NTM), which replaces the single Gaussian distribution of each denoising step in diffusion models with conditional normalizing flows. This allows four-step sampling to match or surpass strong baselines while retaining exact likelihood over the generation trajectory, thereby supporting training strategies dependent on likelihood such as self-distillation.

2026-10-08 08:00 GMT+8

Diffusion models decompose sampling into many small Gaussian denoising steps; this approximation holds when there are ample steps, but when generation is compressed into a few coarse transitions, the distribution at each step no longer approximates a Gaussian. Existing few-step methods—distillation, consistency training, adversarial objectives—adapt to this reality by bypassing step-by-step denoising, at the cost of abandoning the exact likelihood framework, which limits training flexibility and the ability to directly model the generative distribution.

In a paper accepted at NeurIPS 2026, the Apple Machine Learning Research team proposes Normalizing Trajectory Models (NTM). The core idea is to no longer assume that each denoising step is a single Gaussian, but instead to model each reverse step as an expressive conditional normalizing flow. Architecturally, NTM uses shallow invertible transformation blocks within each step to handle local distribution transformations, while using a deep parallel predictor across the trajectory to capture global structure, forming an end-to-end trainable network that can be trained from scratch or initialized from pretrained flow-matching models.

Exact trajectory likelihood brings a direct consequence: the score function induced by the model itself can be used for self-distillation—a lightweight denoiser trained on the score signal generated by the NTM itself can produce high-quality samples in four steps. The authors report that on text-to-image benchmarks, NTM matches or outperforms strong image generation baselines in four-step sampling, while uniquely retaining exact likelihood over the generation trajectory. It should be noted that these performance claims come from author-reported results in the paper's abstract; specific benchmark numbers, ablation studies, and failure modes are contained in the full text, which has not been read in its entirety here. NTM provides a concrete architectural solution to the speed-likelihood contradiction, but the magnitude of its actual advantages awaits confirmation through complete experimental evidence and independent reproduction.

Entrar / Cadastrar
LeituraPesquisaRadarFramework de investimento

Fontes

  • machinelearning.apple.comApple Machine Learning Research↗
Tópico

NTM归一化轨迹模型

苹果公司机器学习研究团队(Apple MLR)在NeurIPS 2026发表《Normalizing Trajectory Models》(NTM),提出一种将扩散模型去噪步骤重构为条件归一化流的新框架。传统扩散模型依赖多步高斯近似,压缩至…

4 etapas1 peçasAtualizado 2026-10-25 05:38

Como chegamos aqui

  1. 2026-05-08论文《Normalizing Trajectory Models》首次提交至arXiv (v1),作者包括Jiatao Gu, Tianrong Chen等,隶属Apple和UIUC。arxiv.org ↗
  2. 2026-08-24论文更新版本(v2)发布,修正拼写和引用,确认代码链接指向GitHub仓库 apple/ml-starflow。arxiv.org ↗
  3. 2026-10-08Apple Machine Learning Research官方博客正式介绍NTM,强调其在文本到图像基准测试中仅用4步即可达到或超过强基线,且保留精确似然。machinelearning.apple.com ↗

O que ainda está indefinido

  • NTM在更大规模数据集或更高分辨率下的扩展性表现如何?
  • 除了图像生成,该框架在视频或其他序列数据上的适用性是否已验证?
  • 社区对“精确似然”在实际生产环境中相对于纯质量指标的价值评估是否有共识?
Ler o tópico completo →
Continuar pesquisando →