LoRazor: Trimming Adapter Execution for Efficient Multi-LoRA Serving
cs.AI
Submitted: 2026-11-05
Updated: 2026-11-05
Terminology
Sources
- Training Verifiers to Solve Math Word Problems
- SkipDecode: Autoregressive Skip Decoding with Batching and Caching for Efficient LLM Inference
- Serving Heterogeneous LoRA Adapters in Distributed LLM Inference Systems
- PreFT: Prefill-only finetuning for efficient inference
- Pin Once, Swap Light: Subspace-Aligned Centroid-Residual Training for Efficient Ultra-LoRA Serving
- Personalization of Large Language Models: A Survey
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents