Learning Conditional Source Distribution via Flow Reversal for Temporal Flow Matching
cs.CV
Submitted: 2026-10-04
Updated: 2026-10-06
Project page: https://embodiedai-ntu.github.io/cnpflow
License: http://creativecommons.org/licenses/by/4.0/
The gist: We introduce CNP-Flow, a flow matching framework for temporal generation that learns conditional source distributions through flow reversal.
Terminology
Abstract
We introduce CNP-Flow, a flow matching framework for temporal generation that learns conditional source distributions through flow reversal. Whereas standard conditional flow matching (FM) incorporates conditioning through the vector field and draws source samples from a standard Gaussian, CNP-Flow uses a conditional noise predictor (CNP) to produce an isotropic Gaussian source for each temporal condition. The CNP is supervised by source samples obtained through flow reversal, which maps observed targets backward through a pretrained FM model. A three-stage pipeline pretrains the FM model, trains the CNP, and fine-tunes the FM model using the learned source distribution, while preserving the FM backbone architecture. Across video prediction, video interpolation, and 7-DoF Franka robot motion planning, CNP-Flow consistently improves generation quality. It also matches baseline performance with fewer function evaluations. Project page: https://embodiedai-ntu.github.io/cnpflow
Sources
- FitVid: Overfitting in Pixel-Level Video Prediction
- COT-FM: Cluster-wise Optimal Transport Flow Matching
- 3D FlowMatch Actor: Unified 3D Policy for Single- and Dual-Arm Manipulation
- Better Source, Better Flow: Learning Condition-Dependent Source Distribution for Flow Matching
- On Equivariance and Fast Sampling in Video Diffusion Models Trained with Warped Noise
- The Lottery Ticket Hypothesis in Denoising: Towards Semantic-Driven Initialization
- Efficient Continuous Video Flow Model for Video Prediction
- ACWM-Phys: Investigating Generalized Physical Interaction in Action-Conditioned Video World Models
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models