GateTrim: Adaptive-Rank Quantization for Large Language Models
cs.LG
Submitted: 2026-10-31
Updated: 2026-10-31
Terminology
Sources
- TwinQuant: Learnable Subspace Decomposition for 4-Bit LLM Quantization
- LQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model Finetuning
- ZeroQuant-V2: Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation
- SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
- OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models
- FlatQuant: Flatness Matters for LLM Quantization
- SpinQuant: LLM quantization with learned rotations
- Pointer Sentinel Mixture Models
- Qwen3 Technical Report
- The Llama 3 Herd of Models
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis