Enabling Efficient Serverless Inference Serving for LLM (Large Language Model) in the Cloud

arXiv:2411.15664 · cs.DC, cs.LG · Submitted 2024-11-23 · Read on arXiv

cs.DC, cs.LG

Submitted: 2024-11-23

Updated: 2024-11-23

Terminology

Related papers