PixReenact: Pixel-Conditioned Causal Video Diffusion for Streaming Head-Avatar Reenactment
cs.CV
Submitted: 2026-10-04
Updated: 2026-10-04
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Streaming head-avatar reenactment aims to animate a reference image according to a live driving video, requiring robust motion transfer, long-term identity stability, and low latency.
Abstract
Streaming head-avatar reenactment aims to animate a reference image according to a live driving video, requiring robust motion transfer, long-term identity stability, and low latency. Existing methods often rely on specialized identity or motion representations, which can discard useful visual information and inherit failure modes from external extractors. In addition, many recent diffusion-based reenactment methods use offline, clip-based generation, jointly processing and denoising an entire video clip before producing its output, making continuous low-latency streaming difficult. We introduce PixReenact, a pixel-conditioned streaming reenactment framework built on causal video diffusion. PixReenact conditions directly on VAE-encoded reference and driving frames, without specialized identity or motion representations. To separate reference identity from driver motion, we train with cross-identity pseudo supervision together with corrective objectives anchored to the original reference and driving inputs. Long self-rollouts reduce autoregressive drift, while state-aware dual-teacher distillation separately addresses cold-start and steady-state generation. Across three cross-identity benchmarks and a long-horizon streaming benchmark, PixReenact demonstrates robust cross-identity reenactment, particularly under challenging conditions such as extreme viewpoints, occlusions, and pronounced facial expressions, while maintaining the reference identity over long streams. A 4-NFE rolling student continuously emits four frames per update with a mean emission latency of 239 ms.
Sources
- Wan-Animate: Unified Character Animation and Replacement with Holistic Replication
- LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control
- PortraitDirector: A Hierarchical Disentanglement Framework for Controllable and Real-time Facial Reenactment
- Avatar Forcing: Real-Time Interactive Head Avatar Generation for Natural Conversation
- Fast Autoregressive Video Diffusion and World Models with Temporal Cache Compression and Sparse Attention
- Wan: Open and Advanced Large-Scale Video Generative Models
- Wan-Animate-2: Pushing the Application Boundaries of Character Animation
- Face Attention Network: An Effective Face Detector for the Occluded Faces
- SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioning
- MegActor: Harness the Power of Raw Video for Vivid Portrait Animation
- Stable Video-Driven Portraits
- Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models