GaugeQuant: Online Learning of Quantization-Optimal Bases from LLM Symmetries
cs.LG, cs.CL
Submitted: 2026-07-22
Updated: 2026-11-04
Code: https://github.com/MPedraBento/gauge-quant
Terminology
Sources
- SliceGPT: Compress Large Language Models by Deleting Rows and Columns
- QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
- LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
- GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
- LoRA: Low-Rank Adaptation of Large Language Models
- Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley Transform
- SpinQuant: LLM quantization with learned rotations
- Pointer Sentinel Mixture Models
- LUT-GEMM: Quantized Matrix Multiplication based on LUTs for Efficient Inference in Large-Scale Generative Language Models
- Qwen2.5 Technical Report
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
- GLU Variants Improve Transformer
- Llama 2: Open Foundation and Fine-Tuned Chat Models
- RoSTE: An Efficient Quantization-Aware Supervised Fine-Tuning Approach for Large Language Models
- A Survey of Large Language Models
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis