Learning What to Imitate: Entropy-Aware Distribution Mixing
cs.LG
Submitted: 2026-10-05
Updated: 2026-10-05
Code: https://github.com/ibm-granite/granite-3.3-language-models
Sources
- LFM2 Technical Report
- Accelerating Large Language Model Decoding with Speculative Sampling
- Training Verifiers to Solve Math Word Problems
- Entropy-Adaptive Fine-Tuning: Resolving Confident Conflicts to Mitigate Forgetting
- Measuring Mathematical Problem Solving With the MATH Dataset
- Distilling the Knowledge in a Neural Network
- Reinforcement Learning via Self-Distillation
- Entropy-Aware On-Policy Distillation of Language Models
- Solving Quantitative Reasoning Problems with Language Models
- Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe
- Entropy-Aware Token Rejection for Improving Speculative Decoding
- LeetCodeDataset: A Temporal Dataset for Robust Evaluation and Efficient Training of Code LLMs
- Qwen3 Technical Report
- Instruction-Following Evaluation for Large Language Models
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks