Kafila: Serving Large Language Models on a Trusted Set of Heterogeneous Commodity Machines
cs.DC, cs.LG
Submitted: 2026-09-28
Updated: 2026-09-28
Code: https://github.com/exo-explore/exo
Related papers
- iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems
- SAMM: Sharded Automated Market Maker
- InferScale: GPU-Native KV Injection for Personalized LLM Serving
- Vigil: Accountable Liveness against Selective Silence
- Steelhead: Interleaving Partially Synchronous and Asynchronous Commit Rules on a Shared DAG
- Democratizing MoE inference on commodity GPUs with CoMoE