Iterating Consistency Models: Stability, Error Bounds and Noise Schedules
stat.ML, cs.CV, cs.LG
Submitted: 2026-10-02
Updated: 2026-10-02
Comments: 27 pages, 6 figures
Code: https://github.com/huggingface/diffusers
License: http://creativecommons.org/licenses/by/4.0/
The gist: Consistency models (CMs) have become a leading approach for generating high-quality samples in few steps.
Terminology
Abstract
Consistency models (CMs) have become a leading approach for generating high-quality samples in few steps. However, adding steps can improve or degrade sample quality in ways that are highly sensitive to the schedule and that existing theory does not fully explain. To provide accuracy guarantees and guide CM sampler design, we analyze multistep CM sampling as a composition of noising and approximate denoising operators. Under explicit, verifiable stability assumptions, we derive a non-asymptotic error bound that separates contraction of the initialization error from accumulation of approximation error. The bound assigns distinct roles to the schedule: large early noise levels drive contraction, while small late noise levels control the residual bias. As a corollary, we obtain explicit constants for strongly log-concave and semi-log-concave targets. We further establish a complementary guarantee whose assumptions, one-step accuracy and stability, can be estimated for a given trained model. Experiments show that the contraction and approximation profiles entering our bounds can be reliably measured and closely match the predicted functional forms. Together, these results provide a meaningful convergence theory for multi-step CMs and a practical route to sampler design.
Sources
- Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
- Flow map matching with stochastic interpolants: A mathematical framework for consistency models
- How to build a consistency model: Learning flow maps via self-distillation
- Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts
- Convergence of denoising diffusion models under the manifold hypothesis
- Consistency Models Made Easy
- Mean Flows for One-step Generative Modeling
- Multistep Consistency Models
- Denoising Diffusion Probabilistic Models
- Imagen Video: High Definition Video Generation with Diffusion Models
- Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion
- Towards a mathematical theory for consistency training in diffusion models
- AudioLDM: Text-to-Audio Generation with Latent Diffusion Models
- Simplifying, Stabilizing and Scaling Continuous-Time Consistency Models
- Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed
- Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Models
- DreamFusion: Text-to-3D using 2D Diffusion
- Hierarchical Text-Conditional Image Generation with CLIP Latents
- Align Your Flow: Scaling Continuous-Time Flow Map Distillation
- Multistep Distillation of Diffusion Models via Moment Matching
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- Efficient quadratic entropy with distance sketches
- Embedding-Bias in Conditional Independence Testing
- From Log-Odds to Shapley Values: An Explanatory Geometry for the Weighted Naive Bayes Classifier