Beyond Accuracy: How Quantization Affects Coding Agents
cs.CL, cs.AI
Submitted: 2026-11-02
Updated: 2026-11-02
Code: https://github.com/vllm-project/llm-compressor
Terminology
Sources
- GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
- DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoning
- OpenAI o1 System Card
- DSBC : Data Science task Benchmarking with Context engineering
- AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
- IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact
- Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models
- Kimi k1.5: Scaling Reinforcement Learning with LLMs
- OJBench: A Competition Level Code Benchmark For Large Language Models
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data