OmniVR: Audio-Video Conditional Generation for Archival Footage Restoration
OmniVR is a joint audio-video restoration model designed to fix visual and audio defects simultaneously in historical films, which existing methods fail to do effectively. It uses a unified multimodal Diffusion Transformer (DiT) to treat restoration as conditional generation, leading to more consistent and higher quality results across both modalities.