Why Transformers Struggle with Distribution-Independent In-Context Learning

arXiv:2502.03503 · stat.ML, cs.AI, cs.LG · Submitted 2025-02-05 · Read on arXiv

stat.ML, cs.AI, cs.LG

Submitted: 2025-02-05

Updated: 2026-11-09

Code: https://github.com/omyokun/icl-polynomials

Terminology

Sources

Related papers