Language Models Can Benefit from Domain-Specific Inductive Biases

arXiv:2611.03756 · cs.LG · Submitted 2026-11-02 · Read on arXiv

cs.LG

Submitted: 2026-11-02

Updated: 2026-11-02

Code: https://github.com/KellerJordan/modded-nanogpt

Project page: https://karpathy.github.io/2015/05/21/rnn-effectiveness

Terminology

Sources

Related papers