Large Language Models without QK-Normalization

arXiv:2611.10560 · cs.CL, cs.AI, cs.LG · Submitted 2026-11-07 · Read on arXiv

cs.CL, cs.AI, cs.LG

Submitted: 2026-11-07

Updated: 2026-11-07

Code: https://github.com/yongding-tao/QK-MAP

Terminology

Sources

Related papers