GreedTok Is a 0.3287-Approximation for Tokenization, Within 3% of the Best Possible Constant

arXiv:2611.07346 · cs.DS · Submitted 2026-11-05 · Read on arXiv

cs.DS

Submitted: 2026-11-05

Updated: 2026-11-09

Comments: 57 pages, 5 figures. Code, checkers and supplement: https://doi.org/10.5281/zenodo.24073514

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Sources

Related papers