DoSA: Dots Sparse Attention
DOSA introduces a lossless method to make computation conditional in sparse attention for Top-K selection. It addresses the bottleneck of scoring every key by using a certificate based on score bounds derived from seed sets and head projections. This allows exact token selection while reducing unnecessary full scoring work, leading to significant speedups.