InfMasking: A Unified Variational Framework for Synergistic Multimodal Learning
cs.CV, cs.AI, cs.LG
Submitted: 2026-11-05
Updated: 2026-11-05
Code: https://github.com/brightest66/InfMasking
Terminology
Sources
- Nonnegative Decomposition of Multivariate Information
- Dependency, Compression, and Synergy: A Unified Information-Theoretic View of Multimodal Learning
- On the Benefits of Early Fusion in Multimodal Representation Learning
- Representation Learning with Contrastive Predictive Coding
- MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs