The Indic Token Tax in 2026: Measuring Tokenizer. Disparity and Its Cost for the Languages of India

arXiv:2611.13058 · cs.CL, cs.AI · Submitted 2026-11-09 · Read on arXiv

cs.CL, cs.AI

Submitted: 2026-11-09

Updated: 2026-11-15

Code: https://github.com/HavonAI/indic-token-tax

Terminology

Sources

Related papers