Token-as-a-Utility: A Model-Agnostic Architecture for Metering and Provisioning AI Inference Services

arXiv:2611.01371 · cs.DC, cs.NI, cs.PF · Submitted 2026-11-01 · Read on arXiv

cs.DC, cs.NI, cs.PF

Submitted: 2026-11-01

Updated: 2026-11-01

Comments: 13 pages, 7 figures; 41-page supplementary material in ancillary files. Submitted to IEEE Transactions on Services Computing. Data and code: https://doi.org/10.5281/zenodo.23792887

Code: https://github.com/Azure/AzurePublicDataset

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Sources

Related papers