PageWeaver: KV-Guided Query Unions for Sparse Attention

PAGEWEAVER is an execution design that uses selected-page affinity to assemble query groups for sparse attention queries while ensuring every query maintains its original support and complete output ownership. It optimizes the cost of executing these fixed sparse relations by greedily grouping queries based on page selection, leading to speedups on H200 hardware.

Open the full episode

More from AI Radio