QUILT: Rethinking Sparse-Attention Prefill through Shared Query Execution
QUILT rethinks sparse-attention prefill by using a workload-aware execution strategy that exploits cross-query reuse. It tackles redundancy caused by neighboring queries sharing KV data, improving hardware utilization and reducing latency significantly compared to existing methods.