Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation
cs.LG, cs.AI, cs.ET
Submitted: 2026-06-01
Updated: 2026-11-05
Code: https://github.com/Adarsh321123/kv-quantization-alignment
Terminology
Sources
- A Survey on Large Language Model Acceleration based on KV Cache Management
- Universal and Transferable Adversarial Attacks on Aligned Language Models
- XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models
- 2 OLMo 2 Furious
- Automating Deception: Scalable Multi-Turn LLM Jailbreaks
- Not Just RLHF: Why Alignment Alone Won't Fix Multi-Agent Sycophancy
- Mistral 7B
- Mixtral of Experts
- Qwen2.5 Technical Report
- Yi: Open Foundation Models by 01.AI
- DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
- The Llama 3 Herd of Models
- Gemma 2: Improving Open Language Models at a Practical Size
- Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis