Open Foundation Models in Healthcare: Challenges, Paradoxes, and Opportunities with GenAI Driven Personalized Prescription

arXiv:2502.04356 · cs.CL, cs.AI, cs.LG · Submitted 2025-02-04 · Read on arXiv

cs.CL, cs.AI, cs.LG

Submitted: 2025-02-04

Updated: 2026-10-12

Terminology

• Foundation Model — 2× in this paper · explained in 3 episodes
• Foundation Models — 2× in this paper · explained in 7 episodes
• RAG — 2× in this paper · explained in 3 episodes
• AI Foundation Model — 1× in this paper · explained in 1 episode
• Grounding — 1× in this paper · explained in 3 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Retrieval-Augmented Generation — 1× in this paper
• Retrieval-Augmented Generation (RAG) — 1× in this paper · explained in 16 episodes

Sources

• Language Models are Few-Shot Learners
• Sparks of Artificial General Intelligence: Early experiments with GPT-4
• GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
• Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting
• Revisiting Few-sample BERT Fine-tuning
• Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectives
• A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics
• On the Opportunities and Risks of Foundation Models
• Code Llama: Open Foundation Models for Code
• Open-Source LLMs for Text Annotation: A Practical Guide for Model Setting and Fine-Tuning
• Llama 2: Open Foundation and Fine-Tuned Chat Models
• Accelerating LLM Inference with Staged Speculative Decoding
• Training Data Leakage Analysis in Language Models
• Privacy Analysis of Deep Learning in the Wild: Membership Inference Attacks against Transfer Learning
• Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigations
• Adversarial Attacks Against Medical Deep Learning Systems
• Generalizability vs. Robustness: Adversarial Examples for Medical Imaging
• Large Language Models Encode Clinical Knowledge
• VisionFM: a Multi-Modal Multi-Task Vision Foundation Model for Generalist Ophthalmic Artificial Intelligence
• LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmark

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering