Leveraging Complementary Event Frame and Voxel Representations for RGB-Guided Multimodal Pre-training
cs.CV, cs.AI
Submitted: 2026-11-09
Updated: 2026-11-09
Code: https://github.com/Event-AHU/CM3AE
Project page: https://wangxiao5791509.github.io
Terminology
Sources
- BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers
- Data-efficient Event Camera Pre-training via Disentangled Masked Modeling
- Qwen2.5-VL Technical Report
- The Llama 3 Herd of Models
- Is Space-Time Attention All You Need for Video Understanding?
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs