ApexQuant: Data-Free Elastic Quantization by Residual Re-Isotropization

arXiv:2610.07904 · cs.LG · Submitted 2026-10-06 · Read on arXiv

cs.LG

Submitted: 2026-10-06

Updated: 2026-10-06

Comments: 25 pages, 6 figures

Code: https://github.com/afristrup/ApexQuant

Project page: https://mobiusml.github.io/hqq_blog

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Quantization — 1× in this paper · explained in 12 episodes

Sources

• Multi-Bitwidth Quantization for LLMs Using Additive Codebooks
• Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
• The Llama 3 Herd of Models
• Mistral 7B
• Textbooks Are All You Need II: phi-1.5 technical report
• SpinQuant: LLM quantization with learned rotations
• Qwen2.5 Technical Report
• Gemma 3 Technical Report
• Llama 2: Open Foundation and Fine-Tuned Chat Models
• MoBiQuant: Mixture-of-Bits Quantization for Token-Adaptive Any-Precision LLM
• TurboQuant: Online Vector Quantization with Near-optimal Distortion Rate
• TinyLlama: An Open-Source Small Language Model

Related papers

• Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
• AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
• Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
• Convergence issues in Relational Concept Analysis based on AOC-posets
• Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
• Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks