ConicFlow: constrained Inference-time optimal control for flow matching models
cs.AI, cs.CV, cs.LG, cs.SY, eess.SY
Submitted: 2026-10-09
Updated: 2026-10-09
Code: https://github.com/shervinkhalafi/conicflow
License: http://creativecommons.org/licenses/by/4.0/
The gist: We propose ConicFlow, which frames constrained sampling from a flow matching model at inference time as an optimal control problem that balances deviation from the pretrained trajectory against
Terminology
Abstract
We propose ConicFlow, which frames constrained sampling from a flow matching model at inference time as an optimal control problem that balances deviation from the pretrained trajectory against reward, subject to hard terminal constraints. We discretize this problem and adapt receding-horizon control, optimizing only a short window of the trajectory at each step for computational tractability. We address the resulting sequence of receding-horizon subproblems with a receding-horizon primal-dual algorithm. Its dual multipliers capture the difficulty of satisfying each constraint and are refined throughout sampling, steering generation toward feasible final samples. We further propose a terminal-estimate variant that avoids accumulating local truncation errors by evaluating the reward and constraints at the predicted terminal point rather than at the end of the current horizon. Under standard regularity assumptions, we establish finite-horizon guarantees on suboptimality. Under convex-affine structure, we derive a sharper bound that scales linearly with omitted horizon length, and we show that the terminal-estimate variant is provably tighter when the flow dynamics change slowly. Experiments in both low- and high-dimensional settings with a recent large-scale flow matching model show that ConicFlow achieves high reward and strong constraint satisfaction while deviating less from the pretrained flow than recent baselines.
Sources
- D-Flow: Differentiating through Flows for Controlled Generation
- Flow map matching with stochastic interpolants: A mathematical framework for consistency models
- How to build a consistency model: Learning flow maps via self-distillation
- Constraint-Aware Flow Matching: Decision Aligned End-to-End Training for Constrained Sampling
- Terminally constrained flow-based generative models from an optimal control perspective
- Classifier-Free Diffusion Guidance
- How to Guide Your Flow: Few-Step Alignment via Flow Map Reward Guidance
- Constrained Flow Matching via Lagrangian Dual Flows
- Flow Matching for Generative Modeling
- Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow
- Fine-Tuning of Continuous-Time Diffusion Models as Entropy-Regularized Control
- Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems