MedToolFault and MedGuard: evaluating and improving clinical agent reliability
cs.CL, cs.AI
Submitted: 2026-10-15
Updated: 2026-10-15
Code: https://github.com/stanfordmlgroup/MedAgentBench
Terminology
Sources
- Beyond Function Calling: Benchmarking Tool-Using Agents under Tool-Environment Unreliability
- ReliabilityBench: Evaluating LLM Agent Reliability Under Production-Like Stress Conditions
- AgentChaos: Chaos Engineering for Agent Systems via Programmatic Fault Injection
- World Feedback for Clinical Agents: Diagnosing RL in FHIR Environments
- Ministral 3
- The Llama 3 Herd of Models
- Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs
- gpt-oss-120b & gpt-oss-20b Model Card
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data