Toward Workflow-Aware Benchmarking for Healthcare NLP Agents

arXiv:2609.00296 · cs.CL · Submitted 2026-08-31 · Read on arXiv

cs.CL

Submitted: 2026-08-31

Updated: 2026-08-31

Comments: 4 pages, 3 tables

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Benchmark — 25× in this paper · explained in 2 episodes
Benchmarking — 4× in this paper · explained in 3 episodes
Fidelity — 4× in this paper · explained in 2 episodes
Hallucination — 4× in this paper · explained in 3 episodes
Provenance — 4× in this paper · explained in 3 episodes
Abstention — 3× in this paper · explained in 1 episode
Action Space — 2× in this paper · explained in 1 episode
Agent Memory — 2× in this paper · explained in 1 episode
Calibration — 2× in this paper · explained in 7 episodes
Consistency — 2× in this paper · explained in 3 episodes
Robustness — 2× in this paper · explained in 5 episodes
Agentic Task — 1× in this paper · explained in 1 episode
Agentic Tasks — 1× in this paper · explained in 1 episode
Aggregation — 1× in this paper · explained in 1 episode
Core — 1× in this paper · explained in 2 episodes
Deferral — 1× in this paper · explained in 2 episodes
Failure Modes — 1× in this paper · explained in 3 episodes
Foundation Model — 1× in this paper · explained in 3 episodes
Foundation Models — 1× in this paper · explained in 7 episodes
Grounding — 1× in this paper · explained in 3 episodes
Knowledge Graph — 1× in this paper · explained in 7 episodes
Large Language Model (LLM) — 1× in this paper · explained in 3 episodes
RAG — 1× in this paper · explained in 3 episodes
Trace — 1× in this paper · explained in 2 episodes

Sources

Related papers