Screening Is Enough
Multiscreen replaces standard softmax attention with a screening mechanism that explicitly rejects irrelevant keys, assigning them zero relevance. This allows relevant keys to be aggregated without competition, improving parameter efficiency and stability. The system achieves better performance in long-context tasks, retrieval, and inference latency compared to traditional Transformers.