Certified Splitting: Decidability and Anchor Supply for Maximal-Munch Tokenization

arXiv:2610.08854 · cs.FL, cs.DC, cs.PL · Submitted 2026-10-04 · Read on arXiv

cs.FL, cs.DC, cs.PL

Submitted: 2026-10-04

Updated: 2026-11-01

Code: https://github.com/nnidhogg/munch

Terminology

Sources

Related papers