Linear Model Merging Unlocks Simple and Scalable Multimodal Data Mixture Optimization
cs.LG, cs.AI, cs.CL
Submitted: 2026-02-04
Updated: 2026-11-08
Code: https://github.com/BerasiDavide/mLLMs_merging_4_DMO
Terminology
Sources
- ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Models
- Concept-Aware Batch Sampling Improves Language-Image Pretraining
- Language Models Improve When Pretraining Data Matches Target Tasks
- Merge to Mix: Mixing Datasets via Model Merging
- To See is to Believe: Prompting GPT-4V for Better Visual Instruction Tuning
- Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
- InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency
- FineVision: Open Data Is All You Need
- LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding
Related papers
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis
- (Mis)generalization of Helpful-Only Fine-tuning