Language model capabilities fail in a shared, predictable order under compression and perturbation
cs.CL, cs.AI, cs.LG
Submitted: 2026-11-08
Updated: 2026-11-08
Code: https://github.com/ZhixiangWang-CN/damage-order-artifacts
Project page: https://zhixiangwang-cn.github.io/damage-order-artifacts
Terminology
Sources
- GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
- ShortGPT: Layers in Large Language Models are More Redundant Than You Expect
- The Unreasonable Ineffectiveness of the Deeper Layers
- What Do Compressed Deep Neural Networks Forget?
- Artificial Aphasias in Lesioned Language Models
- Training Verifiers to Solve Math Word Problems
- Evaluating Large Language Models Trained on Code
- Program Synthesis with Large Language Models
- Instruction-Following Evaluation for Large Language Models
- On the Limits of Layer Pruning for Generative Reasoning in Large Language Models
- Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models
- Qwen2.5 Technical Report
- The Llama 3 Herd of Models
- Mistral 7B
- Gemma 2: Improving Open Language Models at a Practical Size
- Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Q-resafe: Assessing Safety Risks and Quantization-aware Safety Patching for Quantized Large Language Models
- LLMs Can Get "Brain Rot": A Pilot Study on Twitter/X
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data