Comparative analysis of privacy-preserving open-source LLMs regarding extraction of diagnostic information from clinical CMR imaging reports
The study tested open-source Large Language Models (LLMs) locally within hospitals to analyze text from cardiac MRI reports securely, avoiding data sharing risks. Results show these models perform very well, with some achieving F1 scores above 0.93. The research proves that open-source LLMs can effectively extract diagnostic categories from complex CMR reports while offering a path to privacy-preserving clinical analysis.