Layer-wise CPU-GPU Scheduling for LLM Inference on Memory-Limited Consumer GPUs

arXiv:2611.01393 · cs.DC · Submitted 2026-11-01 · Read on arXiv

cs.DC

Submitted: 2026-11-01

Updated: 2026-11-01

Code: https://github.com/huggingface/accelerate

Terminology

Sources

Related papers