Complexity-aware fine-tuning
cs.LG, cs.CL
Submitted: 2025-06-26
Updated: 2026-02-24
Code: https://github.com/LabARSS/complexity-aware-fine-tuning
Terminology
Sources
- Training Verifiers to Solve Math Word Problems
- DeepSeek-V3 Technical Report
- LM-Polygraph: Uncertainty Estimation for Language Models
- The Llama 3 Herd of Models
- Universal Language Model Fine-tuning for Text Classification
- Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes
- Language Models (Mostly) Know What They Know
- Strategic Data Ordering: Enhancing Large Language Model Performance through Curriculum Learning
- Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs
- The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark
- Efficient Reinforcement Finetuning via Adaptive Curriculum Learning
- When an LLM is apprehensive about its answers -- and when its uncertainty is justified
- MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- Qwen2 Technical Report
- Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvement
- SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Models
- LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Dataset
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis