Outgrowing the Curse of Multilinguality: Scaling Strategies for Efficient Language Adaptation
cs.CL, cs.AI, cs.LG
Submitted: 2025-12-11
Updated: 2026-11-06
Code: https://github.com/liu-nlp/multilingual-scaling
Terminology
Sources
- SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
- To Code, or Not To Code? Exploring Impact of Code in Pre-training
- Goldfish: Monolingual Language Models for 350 Languages
- Net2Net: Accelerating Learning via Knowledge Transfer
- Fusing finetuned models for better pretraining
- Efficient and Effective Text Encoding for Chinese LLaMA and Alpaca
- Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier
- EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Models
- MultiBLiMP 1.0: A Massively Multilingual Benchmark of Linguistic Minimal Pairs
- Gemma 3 Technical Report
- Family Matters: Language Transfer and Merging for Adapting Small LLMs to Faroese
- Gemma: Open Models Based on Gemini Research and Technology
- FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
- Sampling Generative Networks
- Qwen3 Technical Report
- Mix-of-Language-Experts Architecture for Multilingual Programming
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data