AREX: Affine-Residual Exponential Integrator for Few-Step Sampling in Flow Matching
stat.ML, cs.AI, cs.LG
Submitted: 2026-10-02
Updated: 2026-10-02
Comments: 53 pages
Code: https://github.com/glasgow233/AREX
License: http://creativecommons.org/licenses/by/4.0/
The gist: We introduce AREX, a training-free sampler for pretrained flow matching models that uses the target mean and covariance to capture an analytically tractable part of the sampling dynamics.
Terminology
Abstract
We introduce AREX, a training-free sampler for pretrained flow matching models that uses the target mean and covariance to capture an analytically tractable part of the sampling dynamics. We show that the velocity field of the moment-matched Gaussian target is the L squared-optimal affine approximation to the marginal velocity field. This motivates decomposition of the learned dynamics into an affine component over the whole sampling path, determined by the first two target moments, and a neural residual term. AREX keeps the affine component and integrates it using an explicit matrix-valued propagator. In turn, we only require to integrate over the residual term. This differs from scalar exponential integrators, which analytically handle only isotropic linear dynamics. Across image and text-to-image generation tasks, AREX consistently improves sample fidelity in the few-step sampling regime without retraining the underlying model.
Sources
- Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generation
- Flow Matching for Generative Modeling
- Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow
- Optimal Transport for Machine Learners
- CAB: Accelerating Flow and Diffusion Sampling via Rectification and Corrected Adams-Bashforth
- Denoising Diffusion Implicit Models
- Improving and generalizing flow-based generative models with minibatch optimal transport
- The Unreasonable Effectiveness of Gaussian Score Approximation for Diffusion Models and its Applications
- Block Flow: Learning Straight Flow on Data Blocks
- SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformers
- Fast Sampling of Diffusion Models with Exponential Integrator
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- Efficient quadratic entropy with distance sketches
- Embedding-Bias in Conditional Independence Testing
- From Log-Odds to Shapley Values: An Explanatory Geometry for the Weighted Naive Bayes Classifier