Contextual Flow Matching: Adaptive Step Selection in Flow Models for Efficient Visual Generation
cs.CV, cs.AI
Submitted: 2026-10-02
Updated: 2026-10-02
Comments: Accepted in NeurIPS 2026
License: http://creativecommons.org/licenses/by/4.0/
The gist: Flow Matching enables high-quality visual generation via continuous-time dynamics, but inference remains costly due to multiple sequential function evaluations.
Terminology
Abstract
Flow Matching enables high-quality visual generation via continuous-time dynamics, but inference remains costly due to multiple sequential function evaluations. Existing acceleration methods reduce the number of function evaluations but often introduce additional training overhead, degrade quality, or fail to account for input-dependent variability. We propose COFLOW, an inference-time method that adaptively selects the step counts each generation based on the prompt features. Our context-aware COFLOW is trained online with an unsupervised reward that balances inference efficiency and generation fidelity. Our method is plug-and-play, requiring no retraining of the underlying generative model. It generalizes to image and video generation, achieving over 2.5x speedup while preserving perceptual and semantic quality. We further provide a theoretical analysis establishing an O(1/K) forward-Euler discretization error bound under standard regularity conditions.
Sources
- Flow Matching for Generative Modeling
- Faster Inference of Flow-Based Generative Models via Improved Data-Noise Coupling
- Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed
- Denoising Diffusion Implicit Models
- Consistency Flow Matching: Defining Straight Flows with Velocity Consistency
- FlowCast: Trajectory Forecasting for Scalable Zero-Cost Speculative Flow Matching
- FastFlow: Accelerating The Generative Flow Matching Models with Bandit Inference
- Flow Matching in Latent Space
- FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space
- FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editing
- Taming Rectified Flow for Inversion and Editing
- HunyuanVideo: A Systematic Framework For Large Video Generative Models
- Wan: Open and Advanced Large-Scale Video Generative Models
- FlowTok: Flowing Seamlessly Across Text and Image Tokens
- Emerging Properties in Unified Multimodal Pretraining
- Pyramidal Flow Matching for Efficient Video Generative Modeling
- Bespoke Solvers for Generative Flow Models
- LeDiFlow: Learned Distribution-guided Flow Matching to Accelerate Image Generation
- Iterative Flow Matching -- Path Correction and Gradual Refinement for Enhanced Generative Modeling
- Step1X-Edit: A Practical Framework for General Image Editing
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models