Rethinking Layer-wise Model Merging through Chain of Merges
cs.LG
Submitted: 2025-08-29
Updated: 2026-10-30
Terminology
Sources
- Layer Normalization
- Reducing Overfitting in Deep Networks by Decorrelating Representations
- The Llama 3 Herd of Models
- REPAIR: REnormalizing Permuted Activations for Interpolation Repair
- A Study of BFLOAT16 for Deep Learning Training
- No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces
- On the importance of single directions for generalization
- ZipIt! Merging Models from Different Tasks without Training
- LLaMA: Open and Efficient Foundation Language Models
- A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis