Trainable Vector Quantization for Large Language Models
cs.LG
Submitted: 2026-10-30
Updated: 2026-10-30
Terminology
Sources
- GPT-4 Technical Report
- Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
- PACT: Parameterized Clipping Activation for Quantized Neural Networks
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- The Llama 3 Herd of Models
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- Mistral 7B
- Adam: A Method for Stochastic Optimization
- The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
- Llama 2: Open Foundation and Fine-Tuned Chat Models
- GPTVQ: The Blessing of Dimensionality for LLM Quantization
- HuggingFace's Transformers: State-of-the-art Natural Language Processing
Related papers
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis
- (Mis)generalization of Helpful-Only Fine-tuning