Correcting Guided Diffusion Trajectories with Spectral Alignment
cs.CV, cs.AI
Submitted: 2026-10-02
Updated: 2026-10-02
License: http://creativecommons.org/licenses/by/4.0/
The gist: The practical success of conditional image generation hinges on fine-grained differences in condition alignment and visual fidelity.
Terminology
Abstract
The practical success of conditional image generation hinges on fine-grained differences in condition alignment and visual fidelity. Classifier-free guidance (CFG) is central to this success, but its lack of an explicit criterion makes it difficult to assess whether the guided trajectory is progressing as intended. To address this gap, we show that spectral alignment provides a principled criterion for understanding guidance behavior and improving guided diffusion sampling through adaptive correction. Our analysis identifies the spectra of intermediate states as an indicator of consistency with the expected spectral evolution of the forward process. Based on this observation, we introduce Spectral Correction Guidance, a method that corrects deviations from an analytic reference spectrum during sampling. The proposed method is training-free and applicable across diffusion backbones and conditional generation tasks without modifying the underlying model. Experiments demonstrate consistent gains in preference-based metrics over baseline guidance methods in text-to-image generation and improved generation quality over CFG on ImageNet. These improvements persist across a range of guidance scales and with fewer denoising steps. Our analyses and ablations provide insight into guidance behavior and how the proposed method affects generation quality.
Sources
- PixArt-$\alpha$: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis
- CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Models
- Classifier-Free Diffusion Guidance
- Stage-wise Dynamics of Classifier-Free Guidance in Diffusion Models
- The Principles of Diffusion Models
- Back to Basics: Let Denoising Generative Models Denoise
- Flow Matching for Generative Modeling
- AudioLDM: Text-to-Audio Generation with Latent Diffusion Models
- Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow
- Understanding Diffusion Models: A Unified Perspective
- Classifier-free Guidance with Adaptive Scaling
- Generating Images with Sparse Representations
- SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis
- No Training, No Problem: Rethinking Classifier-Free Guidance for Diffusion Models
- Guidance in the Frequency Domain Enables High-Fidelity Sampling at Low CFG Scales
- Denoising Diffusion Implicit Models
- Score-Based Generative Modeling through Stochastic Differential Equations
- Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis
- SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformers
- FreCaS: Efficient Higher-Resolution Image Generation via Frequency-aware Cascaded Sampling
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models