Understanding Trajectory Heterogeneity in Federated World Model Learning
cs.LG, cs.CL
Submitted: 2026-10-02
Updated: 2026-10-02
License: http://creativecommons.org/licenses/by/4.0/
The gist: World models learn state evolution from trajectories, making access to temporal context a central training requirement.
Terminology
Abstract
World models learn state evolution from trajectories, making access to temporal context a central training requirement. Federated learning can use distributed records, while ownership boundaries within a trajectory restrict the examples each client can construct. Our study benchmarks this cross-time setting through hourly action-conditioned clinical prediction on eight MIMIC-IV disease cohorts, comprising 40.87 million transition memberships. We specify severity-based client ownership, patient-separated construction, local history and future-window rules, and paired rollout evaluation from one to 32 hours. A matrix of ten federated algorithms covers 32 disease--partition configurations under five rounds of ten-percent participation. Three findings emerge from existing results and training logs. First, client ownership and participation jointly restrict long-window coverage: only 7.55%--21.36% of pooled-available 32-step windows have a locally complete anchor visited during training, averaged across diseases. Second, finer severity partitions accompany higher FedAvg error in 15 of 16 paired comparisons, while algorithm gains are small and horizon-dependent: FedProx reduces mean error by 0.56%, with no consistent improvement at 32 steps. Third, algorithm labels conceal distinct update behavior, including inactive extrapolation and orders-of-magnitude differences in update scale. Cached-update performance also varies strongly across trajectory partitions under the same benchmark protocol. These results establish temporal access, participation coverage, optimization behavior, and horizon-resolved prediction as complementary dimensions for evaluating federated clinical world models.
Sources
- World Models
- LEAF: A Benchmark for Federated Settings
- FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settings
- Benchmarking Catastrophic Forgetting Mitigation Methods in Federated Time Series Forecasting
- Dream to Control: Learning Behaviors by Latent Imagination
- Mastering Atari with Discrete World Models
- TD-MPC2: Scalable, Robust World Models for Continuous Control
- GAIA-1: A Generative World Model for Autonomous Driving
- EHRWorld: A Patient-Centric Medical World Model for Long-Horizon Clinical Trajectories
- ChronoMedicalWorld: A Medical World Model for Learning Patient Trajectories from Longitudinal Care Data
- Federated Learning Based on Dynamic Regularization
- FedBN: Federated Learning on Non-IID Features via Local Batch Normalization
- FedML: A Research Library and Benchmark for Federated Machine Learning
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks