MedGemma vs GPT-4: Open-Source and Proprietary Zero-shot Medical Disease Classification from Images
cs.CV, cs.AI
Submitted: 2025-12-29
Updated: 2026-10-27
Comments: Accepted for publication in the Journal of Machine Learning and Deep Learning (JMLDL). 9 pages, 9 figures, 10 tables
Journal ref: Journal of Machine Learning and Deep Learning, Vol. 2, No. 2, pp. 1-9, 2025
DOI: 10.64820/AEPJMLDL.22.1.9.122025
License: http://creativecommons.org/licenses/by/4.0/
The gist: Multimodal Large Language Models (LLMs) introduce an emerging paradigm for medical imaging by interpreting scans through the lens of extensive clinical knowledge…
Terminology
Abstract
Multimodal Large Language Models (LLMs) introduce an emerging paradigm for medical imaging by interpreting scans through the lens of extensive clinical knowledge, offering a transformative approach to disease classification. This study presents a critical comparison between two fundamentally different AI architectures: the specialized open-source agent MedGemma and the proprietary large multimodal model GPT-4 for diagnosing six different diseases. The MedGemma-4b-it model, fine-tuned using Low-Rank Adaptation (LoRA), demonstrated superior diagnostic capability by achieving a mean test accuracy of 80.37% compared to 69.56% for the untuned GPT-4. Furthermore, MedGemma exhibited notably higher sensitivity in high-stakes clinical tasks, such as cancer and pneumonia detection. Quantitative analysis via confusion matrices and classification reports provides comprehensive insights into model performance across all categories. These results emphasize that domain-specific fine-tuning is essential for minimizing hallucinations in clinical implementation, positioning MedGemma as a sophisticated tool for complex, evidence-based medical reasoning.
Sources
- Large Language Models Encode Clinical Knowledge
- Towards Expert-Level Medical Question Answering with Large Language Models
- Weak convergence and tightness of probability measures in an abstract Skorohod space
- Publicly Available Clinical BERT Embeddings
- MedGemma Technical Report
- GPT-4 Technical Report
- Explainable AI applications in the Medical Domain: a systematic review
- DeepViT: Towards Deeper Vision Transformer
- LoRA: Low-Rank Adaptation of Large Language Models
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs