Destination-Conditioned Adaptation with Semantic-Geometric Alignment for Generative Inbetweening
cs.CV
Submitted: 2026-10-09
Updated: 2026-10-09
License: http://creativecommons.org/licenses/by/4.0/
The gist: Generative inbetweening aims to synthesize temporally coherent intermediate frames between a start frame and a target frame.
Terminology
Abstract
Generative inbetweening aims to synthesize temporally coherent intermediate frames between a start frame and a target frame. Although pretrained image-to-video diffusion models provide strong priors for large-motion inbetweening, they are not explicitly designed to reach a specified target frame. They may therefore generate realistic individual frames while drifting from the target or producing unstable motion under large displacements and non-rigid dynamics. We propose DSG-GI, a framework that adapts pretrained latent video diffusion models through Destination-Conditioned Adaptation and Semantic-Geometric Alignment. Destination-Conditioned Adaptation treats the target frame as the destination of the sequence and provides temporally progressive guidance along the generated trajectory. Semantic-Geometric Alignment aligns the token-wise spatio-temporal relational geometry of backbone features with that of a frozen video foundation encoder and applies a flow-matching-aware latent flow constraint to samples near the data endpoint of the probability path. Together, these components strengthen destination guidance and preserve coherent semantic-geometric motion structure. Extensive experiments on standard and large-motion inbetweening benchmarks demonstrate improvements in temporal stability, target-frame faithfulness, and perceptual quality. Our code will be made publicly available.
Sources
- V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning
- Qwen3-VL Technical Report
- Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
- AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning
- CameraCtrl: Enabling Camera Control for Text-to-Video Generation
- Motion Prior Distillation in Time Reversal Sampling for Generative Inbetweening
- Adam: A Method for Stochastic Optimization
- Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videos
- Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow
- ControlNeXt: Powerful and Efficient Control for Image and Video Generation
- Wan: Open and Advanced Large-Scale Video Generative Models
- SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models