Golden Anchor for Video Generation
cs.CV, cs.LG
Submitted: 2026-10-09
Updated: 2026-10-12
Comments: 22 pages (including references and appendices), 3 figures, 8 tables
License: http://creativecommons.org/licenses/by/4.0/
The gist: Video generation supports digital content creation, with applications in virtual avatars, AI-driven filmmaking, interactive game engines, and world models.
Abstract
Video generation supports digital content creation, with applications in virtual avatars, AI-driven filmmaking, interactive game engines, and world models. State-of-the-art systems achieve controllability primarily through image-to-video (I2V) generation, in which an injected anchor image determines the identity, composition, and style of the resulting video. In modern pipelines, this anchor is synthesized by a text-to-image (T2I) generator. This raises a largely overlooked question: Are images obtained directly from the T2I model truly suitable for current video models? Our analysis shows that anchor aesthetic and quality scores are weakly correlated with downstream video quality. The structure-and-texture score is negatively correlated with I2V video quality in both the visual and motion dimensions. Fine-tuning the T2I model on an image reward accordingly yields anchors with visibly denser structural and character detail: they score higher on image metrics, yet lower the video reward on every I2V model we test and change downstream motion unpredictably. We therefore introduce Golden Anchor Learning (GAL), to our knowledge the first framework for learning golden anchors by optimizing a T2I generator with downstream video feedback. GAL evaluates candidate anchors through the videos they induce under a frozen I2V model and converts video rewards into image-level preferences for DPO fine-tuning of the T2I generator. On all four I2V models, GAL raises the VBench average by 2.97% -- 8.46% over the untuned generator. The rendered clips also score higher under VideoReward-Overall, and their extracted frames under HPSv3 and UniPercept. GAL yields consistent motion gains across all four I2V models, as measured by a 5.62% -- 38.24% increase in VBench dynamic degree. Although GAL is trained only on HunyuanVideo-1.5 renders, these gains extend to the other three I2V models.
Sources
- MaineCoon: Pursuing A Real-Time Audio-Visual Social World Model
- Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
- FlashI2V: Fourier-Guided Latent Shifting Prevents Conditional Image Leakage in Image-to-Video Generation
- I4VGen: Image as Free Stepping Stone for Text-to-Video Generation
- LTX-Video: Realtime Video Latent Diffusion
- Rebalancing Reference Frame Dominance to Improve Motion in Image-to-Video Models
- Kling-Omni Technical Report
- HunyuanVideo: A Systematic Framework For Large Video Generative Models
- Cosmos World Foundation Model Platform for Physical AI
- Movie Gen: A Cast of Media Foundation Models
- MagicDistillation: Weak-to-Strong Video Distillation for Large-Scale Few-Step Synthesis
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- Wan: Open and Advanced Large-Scale Video Generative Models
- HunyuanVideo 1.5 Technical Report
- Automated Movie Generation via Multi-Agent CoT Planning
- Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis
- DiffLoRA: Generating Personalized Low-Rank Adaptation Weights with Diffusion
- EvoState: Closed-Loop Visual State Management for Long-Form Video Generation
- Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformer
- I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Models
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models