Visual Instruction Tuning Aligns Modalities through Abstraction
cs.CV, cs.CL, cs.LG
Submitted: 2026-06-02
Updated: 2026-11-10
Code: https://github.com/meta-llama/llama-models
Terminology
Sources
- Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond
- Gemma 3 Technical Report
- LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Training
- Chameleon: Mixed-Modal Early-Fusion Foundation Models
- The Llama 3 Herd of Models
- Are We on the Right Way for Evaluating Large Vision-Language Models?
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- WinoGrande: An Adversarial Winograd Schema Challenge at Scale
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs