MetaPI: Constructing Prompt Injection Benchmarks from LLM Agent Benchmark
cs.CR, cs.AI
Submitted: 2026-11-05
Updated: 2026-11-05
Code: https://github.com/WhileBug/MetaPI2
Terminology
Sources
- Meta-SecAlign: Training LLMs against Prompt Injection for Robust Agents
- DecodingTrust-Agent Platform (DTap): A Controllable and Interactive Red-Teaming Platform for AI Agents
- Systems Security Foundations for Agentic Computing
- Defeating Prompt Injections by Design
- WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks
- PIArena: A Platform for Prompt Injection Evaluation
- Defending Against Indirect Prompt Injection Attacks With Spotlighting
- Taxonomy, Evaluation and Exploitation of IPI-Centric LLM Agent Defense Frameworks
- Prompt Flow Integrity to Prevent Privilege Escalation in LLM Agents
- AgentDyn: Are Your Agent Security Defenses Deployable in Real-World Dynamic Environments?
- Prompt Injection attack against LLM-integrated Applications
- MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Servers
- AutoDojo: A Generative Benchmark for Evaluating Prompt Injection Defenses in LLM Agents
- EnterpriseOps-Gym: Environments and Evaluations for Stateful Agentic Planning and Tool Use in Enterprise Settings
- Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
- The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injections
- Prompt Injection Attack to Tool Selection in LLM Agents
- Progent: Securing AI Agents with Privilege Control
- PromptArmor: Simple yet Effective Prompt Injection Defenses
- The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysis
Related papers
- From Strategy Search to Policy Learning: MCTS-Guided Adversarial Co-Evolution for LLM Safety Alignment
- Privacy Leakage from Recurrent State in LLM Inference
- Incrementally Verifiable Oracle Aided Computation
- Privilege and confidentiality in generative AI workflows
- BadMoE: Backdooring Mixture-of-Experts LLMs via Routing-Aware Triggers and Task-Underutilized Experts
- CoVault: Secure, Scalable Analytics of Personal Data