CAT-Flow: Curvature-Adaptive sTeps for Flow Matching
cs.LG
Submitted: 2026-09-01
Updated: 2026-09-01
Code: https://github.com/discus0434/aesthetic-predictor-v2-5
License: http://creativecommons.org/licenses/by/4.0/
The gist: Flow Matching has emerged as a leading framework for generative modeling, powering state-of-the-art systems such as FLUX and Stable Diffusion 3.5.
Terminology
Abstract
Flow Matching has emerged as a leading framework for generative modeling, powering state-of-the-art systems such as FLUX and Stable Diffusion 3.5. However, the iterative nature of its ODE-based sampling process creates a fundamental efficiency bottleneck: the quality of generated samples is highly sensitive to the choice of step-sizes, and current models typically require 20 to 30 steps for good quality. In this work, we propose two lightweight, training-free algorithms, CAT-OV and CAT-OT that adapt step-sizes at inference time based on a novel connection between Flow Matching sampling and gradient flow. Our algorithms are computed efficiently by not requiring additional neural function evaluations. Specifically, CAT-OT estimates curvature over time via a finite-difference approximation of the time-derivative of the vector field, while CAT-OV approximates curvature over the state space via a gradient of the vector field. Under suitable conditions, both methods have truncation error bounds of constant order. Empirically, CAT-OV and CAT-OT outperform existing step-size heuristics in image quality metrics across four text- to-image Flow Matching models, reducing the number of generation steps required to reach comparable quality by up to 40%.
Sources
- Stable Flow: Vital Layers for Training-Free Image Editing
- Training-Free Refinement of Flow Matching with Divergence-based Sampling
- ProbeFlow: Training-Free Adaptive Flow Matching for Vision-Language-Action Models
- Generating Sequences With Recurrent Neural Networks
- Prediction--Loss Alignment for Sampler--Robust Flow Matching Training
- Gotta Go Fast When Generating Data with Score-Based Models
- A study of deep perceptual metrics for image quality assessment
- Isokinetic Flow Matching for Pathwise Straightening of Generative Flows
- Adam: A Method for Stochastic Optimization
- FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space
- Cost-Aware Routing for Efficient Text-To-Image Generation
- Flow Matching Guide and Code
- CurveFlow: Curvature-Guided Flow Matching for Image Generation
- Look-Ahead and Look-Back Flows: Training-Free Image Generation with Trajectory Smoothing
- Adams Bashforth Moulton Solver for Inversion and Editing in Rectified Flow
- Bellman Optimal Stepsize Straightening of Flow-Matching Models
- PromptMoG: Enhancing Diversity in Long-Prompt Image Generation via Prompt Embedding Mixture-of-Gaussian Sampling
- UniFlow-Audio: Unified Flow Matching for Audio Generation from Omni-Modalities
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks