Scaling Recurrence-aware Foundation Models for Clinical Records via Next-Visit Prediction
cs.LG
Submitted: 2026-03-25
Updated: 2026-11-05
Code: https://github.com/xgao0o/RAVEN
Terminology
Sources
- CEHR-XGPT: A Scalable Multi-Task Foundation Model for Electronic Health Records
- Generative Medical Event Models Improve with Scale
- Foresight -- Generative Pretrained Transformer (GPT) for Modelling of Patient Timelines using EHRs
- Scaling Laws for Neural Language Models
- Training Compute-Optimal Large Language Models
- Exploring Scaling Laws for EHR Foundation Models
- Pre-training under infinite compute
- MedGemma Technical Report
- Efficient Sequence Packing without Cross-contamination: Accelerating Large Language Models without Impacting Performance
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis