Finitely Verifiable Segmentation: Decidability for Every Tokenizer with a Finite-State Verifier

arXiv:2610.30168 · cs.FL, cs.CL, cs.PL · Submitted 2026-10-16 · Read on arXiv

cs.FL, cs.CL, cs.PL

Submitted: 2026-10-16

Updated: 2026-10-16

Terminology

Related papers