KVGuard: A KV Cache Safety Checker for LLM Serving Systems
cs.CR
Submitted: 2026-11-04
Updated: 2026-11-04
Code: https://github.com/NVIDIA/TensorRT-LLM
Terminology
Sources
- The Llama 3 Herd of Models
- Qwen2.5 Technical Report
- Continuous Discovery of Vulnerabilities in LLM Serving Systems with Fuzzing
Related papers
- From Strategy Search to Policy Learning: MCTS-Guided Adversarial Co-Evolution for LLM Safety Alignment
- Privacy Leakage from Recurrent State in LLM Inference
- Incrementally Verifiable Oracle Aided Computation
- Privilege and confidentiality in generative AI workflows
- BadMoE: Backdooring Mixture-of-Experts LLMs via Routing-Aware Triggers and Task-Underutilized Experts
- CoVault: Secure, Scalable Analytics of Personal Data