An Efficient Heterogeneous Co-Design for Fine-Tuning on a Single GPU

arXiv:2603.16428 · cs.DC, cs.AI · Submitted 2026-03-17 · Read on arXiv

cs.DC, cs.AI

Submitted: 2026-03-17

Updated: 2026-06-30

Terminology

• Fine-Tuning — 4× in this paper · explained in 5 episodes
• Domain Adaptation — 1× in this paper · explained in 5 episodes
• Language Models (LLMs) — 1× in this paper · explained in 2 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 9 episodes

Related papers

• iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems
• Load Balancing with Evolving Workloads in Large-Scale Language Model Serving
• Dooly: Configuration-Agnostic, Redundancy-Aware Profiling for LLM Inference Simulation
• SAMM: Sharded Automated Market Maker
• InferScale: GPU-Native KV Injection for Personalized LLM Serving
• Vigil: Accountable Liveness against Selective Silence