HYPIC: Position-Independent Caching for Hybrid-Attention LLM Serving

arXiv:2607.01299 · cs.DC · Submitted 2026-07-01 · Read on arXiv

cs.DC

Submitted: 2026-07-01

Updated: 2026-11-04

Code: https://github.com/ai-dynamo/nixl

Terminology

Sources

Related papers