Provisioning Networks for AI Supercomputers: A Trace-Driven Study of Performance Sensitivity at Unprecedented Scale
cs.NI
Submitted: 2026-10-30
Updated: 2026-10-30
Code: https://github.com/microsoft/NPK
Terminology
Sources
- The rising costs of training frontier AI models
- The Llama 3 Herd of Models
- Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
- DeepSeek-V3 Technical Report
- Chakra: Advancing Performance Benchmarking and Co-design using Standardized Execution Traces
- Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Related papers
- Predicting Networks Before They Happen: Experimentation on a Real-Time V2X Digital Twin
- MultiMoQ: Multi-Access Media-Over-QUIC for Robust Immersive Video Streaming
- HiFiNet: Hierarchical Fault Identification in Wireless Sensor Networks via Edge-Based Classification and Graph Aggregation
- Flux: Optimal Scheduling of Optical Circuit Switches for LLM Training
- Tutorial on Closed-Loop and Application-Aware Digital Twins for Future Wireless Networks
- Claude Code Complete User Handbook