Inference Validation for Regulated AI: A Governed Decision Pipeline for LLM Serving

arXiv:2611.12737 · cs.SE, cs.LG, cs.PF · Submitted 2026-11-09 · Read on arXiv

cs.SE, cs.LG, cs.PF

Submitted: 2026-11-09

Updated: 2026-11-11

Code: https://github.com/ai-dynamo/aiperf

Project page: https://nvidia.github.io/TensorRT-LLM/features/kvcache.html

Terminology

Sources

Related papers