A Parameter-Efficient Transfer Learning Approach through Multitask Prompt Distillation and Decomposition for Clinical NLP
cs.CL, cs.AI
Submitted: 2026-04-08
Updated: 2026-11-14
Terminology
Sources
- Parameter-Efficient Transfer Learning for NLP
- LoRA: Low-Rank Adaptation of Large Language Models
- ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts
- Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learning
- The Llama 3 Herd of Models
- gpt-oss-120b & gpt-oss-20b Model Card
- MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
- BioNLI: Generating a Biomedical NLI Dataset Using Lexico-semantic Constraints for Adversarial Examples
- SDOH-NLI: a Dataset for Inferring Social Determinants of Health from Clinical Notes
- NLI4CT: Multi-Evidence Natural Language Inference for Clinical Trial Reports
- CHQ-Summ: A Dataset for Consumer Healthcare Question Summarization
- HEAD-QA: A Healthcare Dataset for Complex Reasoning
- Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questions
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data