VidDub: Replacement-Aware Supervision for Two-Step Video Dubbing
cs.CV
Submitted: 2026-11-02
Updated: 2026-11-18
Code: https://github.com/LAW1223/VidDub
Terminology
Sources
- Lip Forcing: Few-Step Autoregressive Diffusion for Real-time Lip Synchronization
- OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animation
- Classifier-Free Diffusion Guidance
- Real-time Facial Surface Geometry from Monocular Video on Mobile GPUs
- LatentSync: Taming Audio-Conditioned Latent Diffusion Models for Lip Sync with SyncNet Supervision
- Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference
- DreamTalk: When Emotional Talking Head Generation Meets Diffusion Probabilistic Models
- Wan: Open and Advanced Large-Scale Video Generative Models
- Towards Accurate Generative Models of Video: A New Metric & Challenges
- AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation
- Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation
- MuseTalk: Real-Time High-Fidelity Video Dubbing via Spatio-Temporal Sampling
- Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation
- Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs