Inference Validation for Regulated AI: A Governed Decision Pipeline for LLM Serving
cs.SE, cs.LG, cs.PF
Submitted: 2026-11-09
Updated: 2026-11-11
Code: https://github.com/ai-dynamo/aiperf
Project page: https://nvidia.github.io/TensorRT-LLM/features/kvcache.html
Terminology
Sources
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters