Towards Better Aligned LLM Judges for Radiology Report Evaluation across Modalities and Anatomies
The study evaluated existing LLM metrics for radiology report evaluation across different imaging types and body parts, not just chest X-rays. The proposed VERT metric showed improved correlation with expert judgments compared to current methods like GREEN, demonstrating that general-purpose LLMs can be effective judges when combined with light adaptation techniques.