What Do Tokenizer Comparisons Measure? Disentangling Granularity, Root Assignment, and Word-Level Readout across Amharic and Hausa

arXiv:2611.14818 · cs.CL, cs.LG · Submitted 2026-11-10 · Read on arXiv

cs.CL, cs.LG

Submitted: 2026-11-10

Updated: 2026-11-10

Terminology

Sources

Related papers