ClinFusion: A Vision-Centric Multimodal LLM System for Holistic Medical Understanding
cs.CV, cs.AI, cs.CL
Submitted: 2026-07-27
Updated: 2026-11-07
Code: https://github.com/alibaba-damo-academy/ClinFusion
Terminology
Sources
- Qwen2.5-VL Technical Report
- Qwen3-VL Technical Report
- GPT-4o System Card
- Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning
- Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understanding
- MedGemma Technical Report
- Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models
- HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale
- MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflow
- InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models
- GSCo: Towards Generalizable AI in Medicine via Generalist-Specialist Collaboration
- CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formats
- 3D-RAD: A Comprehensive 3D Radiology Med-VQA Dataset with Multi-Temporal Analysis and Diverse Diagnostic Tasks
- Perception Encoder: The best visual embeddings are not at the output of the network
- M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models
- DMQR-RAG: Diverse Multi-Query Rewriting for RAG
- A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretation
- GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical Reasoning
- ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Models
- HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs