Where to Connect? Boosting MLLMs via Dynamic Gated Pathways across ALL ViT and LLM Layers
cs.CV
Submitted: 2026-11-04
Updated: 2026-11-04
Code: https://github.com/YingyingYan1/DGP
Terminology
Sources
- Qwen3-VL Technical Report
- Remember-R1: Mitigating Long-Context Visual Forgetting through Reinforcement Learning
- EVLM: An Efficient Vision-Language Model for Visual Understanding
- Shikra: Unleashing Multimodal LLM's Referential Dialogue Magic
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- GPT-4o System Card
- SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehension
- TGIF: Text-Guided Layer Fusion Mitigates Hallucination in Multimodal LLMs
- DINOv2: Learning Robust Visual Features without Supervision
- Dynamic Embedding of Hierarchical Visual Features for Efficient Vision-Language Fine-Tuning
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities
- Sparse Shortcuts: Facilitating Efficient Fusion in Multimodal Large Language Models
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs