Emo-LiveSync: Real-Time Universal Lip Synchronization with Explicit Emotion Control
cs.CV
Submitted: 2026-11-06
Updated: 2026-11-06
Terminology
Sources
- HunyuanVideo-Avatar: High-Fidelity Audio-Driven Human Animation for Multiple Characters
- OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animation
- Wan-S2V: Audio-Driven Cinematic Video Generation
- Gemini: A Family of Highly Capable Multimodal Models
- LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control
- LatentSync: Taming Audio-Conditioned Latent Diffusion Models for Lip Sync with SyncNet Supervision
- SayAnything: Audio-Driven Lip Synchronization with Conditional Video Diffusion
- DreamTalk: When Emotional Talking Head Generation Meets Diffusion Probabilistic Models
- EMO2: End-Effector Guided Audio-Driven Avatar Video Generation
- Towards Accurate Generative Models of Video: A New Metric & Challenges
- V-Express: Conditional Dropout for Progressive Training of Portrait Video Generation
- AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation
- EmoSteer-TTS: Fine-Grained and Training-Free Emotion-Controllable Text-to-Speech via Activation Steering
- Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation
- Make Your Actor Talk: Generalizable and High-Fidelity Lip Sync with Motion and Appearance Disentanglement
- SyncAnyone: Implicit Disentanglement via Progressive Self-Correction for Lip-Syncing in the wild
- MuseTalk: Real-Time High-Fidelity Video Dubbing via Spatio-Temporal Sampling
- Style-Preserving Lip Sync via Audio-Aware Style Reference
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs