CoreQ: Mismatch-Corrected Successive Rounding for LLM Quantization
cs.LG, cs.AI
Submitted: 2026-02-05
Updated: 2026-11-18
Terminology
Sources
- SqueezeLLM: Dense-and-Sparse Quantization
- On-Device Language Models: A Comprehensive Review
- BRECQ: Pushing the Limit of Post-Training Quantization by Block Reconstruction
- GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
- ApiQ: Finetuning of 2-Bit Quantized Large Language Model
- Model-Preserving Adaptive Rounding
- BoA: Attention-aware Post-training Quantization without Backpropagation
- CBQ: Cross-Block Quantization for Large Language Models
- The Geometry of LLM Quantization: GPTQ as Babai's Nearest Plane Algorithm
- First-Order Error Matters: Accurate Compensation for Quantized Large Language Models
- CDQuant: Greedy Coordinate Descent for Accurate LLM Quantization
- LLaMA: Open and Efficient Foundation Language Models
- The Llama 3 Herd of Models
- Qwen3 Technical Report
- Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
- HellaSwag: Can a Machine Really Finish Your Sentence?
- BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Measuring Massive Multitask Language Understanding
- Training Verifiers to Solve Math Word Problems
Related papers
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis
- (Mis)generalization of Helpful-Only Fine-tuning