DataHelix: A CPU-GPU Co-Scheduling Data Plane for Multimodal Model Training
cs.DC, cs.AI
Submitted: 2026-11-06
Updated: 2026-11-06
Code: https://github.com/NVIDIA/DALI
Terminology
Sources
- tf.data service: A Case for Disaggregating ML Input Data Processing
- Efficient Sequence Packing without Cross-contamination: Accelerating Large Language Models without Impacting Performance
- Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines
- FFCV: Accelerating Training by Removing Data Bottlenecks
- Analyzing and Mitigating Data Stalls in DNN Training
- tf.data: A Machine Learning Data Processing Framework
Related papers
- Programmable Probabilistic Computer with 1,000,000 p-bits
- BatchGen: An Architecture for Scalable and Efficient Batch Inference
- Seamless Reconfiguration for DAG-BFT (Technical Report)
- ELDR: Expert-Locality-Aware Decode Routing for PD-Disaggregated MoE Serving
- iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems
- TIRx: A Unified Tile Primitive ML Compiler Across Heterogeneous Backends