A Cardiorespiratory Foundation Model Pretrained on Ten Physiological Signals for Perioperative and Critical Care
cs.LG, cs.AI
Submitted: 2026-11-11
Updated: 2026-11-11
Code: https://github.com/dlcjfgmlnasa/CARMEN
Terminology
Sources
- BIOT: Cross-data Biosignal Learning in the Wild
- QualityFM: a Multimodal Physiological Signal Foundation Model with Self-Distillation for Signal Quality Challenges in Critically Ill Patients
- MorphologyFM: A Foundation Model for Morphology-Aware Representation Learning from ECG and Pulse Oximetry Waveforms
- MOMENT: A Family of Open Time-series Foundation Models
- Toward Foundation Model for Multivariate Wearable Sensing of Physiological Signals
- SPOTR: Spatio-temporal Pooling One-Token Reconstruction for Universal Physiological Signal Self-supervised Learning
- Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogram
- Learning General Representation of 12-Lead Electrocardiogram with a Joint-Embedding Predictive Architecture
- AnyPPG: An ECG-Guided PPG Foundation Model Trained on Over 100,000 Hours of Recordings for Holistic Health Profiling
- Pulse-PPG: An Open-Source Field-Trained PPG Foundation Model for Wearable Applications Across Lab and Field Settings
- A decoder-only foundation model for time-series forecasting
- FiLM: Visual Reasoning with a General Conditioning Layer
- RoFormer: Enhanced Transformer with Rotary Position Embedding
- Efficient Sequence Packing without Cross-contamination: Accelerating Large Language Models without Impacting Performance
- Unified Training of Universal Time Series Forecasting Transformers
- GLU Variants Improve Transformer
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis