MedVAL: Toward Expert-Level Medical Text Validation with Language Models
cs.CL, cs.AI, cs.LG
Submitted: 2025-07-03
Updated: 2026-02-06
Code: https://github.com/StanfordMIMI/MedVAL
Terminology
Sources
- Deep Learning, Natural Language Processing, and Explainable Artificial Intelligence in the Biomedical Domain
- Advancing Conversational Diagnostic AI with Multimodal Reasoning
- Med-HALT: Medical Domain Hallucination Test for Large Language Models
- A Survey of Large Language Models
- Sparks of Artificial General Intelligence: Early experiments with GPT-4
- Design Considerations for High Impact, Automated Echocardiogram Analysis
- A Survey on LLM-as-a-Judge
- FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
- AlignScore: Evaluating Factual Consistency with a Unified Alignment Function
- Calibrating Expressions of Certainty
- Linguistic Calibration of Long-Form Generations
- Enhancing Language Model Factuality via Activation-Based Confidence Calibration and Guided Decoding
- MedHal: a Synthetic Dataset for Medical Hallucination Detection
- DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generation
- VeriFact: Verifying Facts in LLM-Generated Clinical Text with Electronic Health Records
- ReXTrust: A Model for Fine-Grained Hallucination Detection in AI-Generated Radiology Reports
- GREEN: Generative Radiology Report Evaluation and Error Notation
- FineRadScore: A Radiology Report Line-by-Line Evaluation Technique Generating Corrections with Severity Scores
- RadGraph: Extracting Clinical Entities and Relations from Radiology Reports
- Benchmarking and Improving Generator-Validator Consistency of Language Models
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data