Efficiently Aligning Draft Models via Parameter- and Data-Efficient Adaptation
cs.LG, cs.AI
Submitted: 2026-03-10
Updated: 2026-11-13
Code: https://github.com/Lyn-Lucy/Efficient-Draft-Adaptation
Terminology
Sources
- Program Synthesis with Large Language Models
- Qwen Technical Report
- Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads
- Accelerating Large Language Model Decoding with Speculative Sampling
- Evaluating Large Language Models Trained on Code
- Training Verifiers to Solve Math Word Problems
- DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning
- Measuring Coding Challenge Competence With APPS
- Measuring Mathematical Problem Solving With the MATH Dataset
- Qwen2.5-Coder Technical Report
- Prefix-Tuning: Optimizing Continuous Prompts for Generation
- Speculative Decoding Reimagined for Multimodal Large Language Models
- WizardCoder: Empowering Code Large Language Models with Evol-Instruct
- Are NLP Models really able to Solve Simple Math Word Problems?
- Qwen2.5 Technical Report
- Code Llama: Open Foundation Models for Code
- LLaMA: Open and Efficient Foundation Language Models
- PMC-LLaMA: Towards Building Open-source Language Models for Medicine
- Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvement
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis