ROCKET: Rapid Optimization via Calibration-guided Knapsack Enhanced Truncation for Efficient Model Compression
cs.LG, cs.AI, cs.CL
Submitted: 2026-02-11
Updated: 2026-11-12
Code: https://github.com/tatsu-lab/stanford_alpaca
Terminology
Sources
- Are We on the Right Way for Evaluating Large Vision-Language Models?
- Distilling the Knowledge in a Neural Network
- Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes
- MMBench: Is Your Multi-modal Model an All-around Player?
- MACKO: Sparse Matrix-Vector Multiplication for Low Sparsity
- The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only
- VibeVoice Technical Report
- MLS: A Large-Scale Multilingual Dataset for Speech Research
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark
- ARA: Adaptive Rank Allocation for Efficient Large Language Model SVD Compression
- ASVD: Activation-aware Singular Value Decomposition for Compressing Large Language Models
- Instruction-Following Evaluation for Large Language Models
- Share Your Attention: Transformer Weight Sharing via Matrix-based Dictionary Learning
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis