Rondo: Controlling Reordering in High-Throughput Packet Spraying
cs.NI
Submitted: 2026-11-03
Updated: 2026-11-03
Code: https://github.com/deepseek-ai/DeepEP
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Modern datacenter applications demand high network bandwidth, motivating packet-level multipath transport to exploit the aggregate capacity of multiple paths.
Terminology
Abstract
Modern datacenter applications demand high network bandwidth, motivating packet-level multipath transport to exploit the aggregate capacity of multiple paths. However, packet reordering under packet spraying poses challenges for hardware transports. Excessive packet reordering makes it difficult to infer packet loss, imposes substantial pressure on NIC resources, and ultimately degrades performance. Existing transports either prioritize throughput without controlling packet reordering, or mitigate reordering by restricting transmissions, which leaves available path capacity unused. In this paper, we identify two fundamental sources of packet reordering: transient inter-path queueing differences caused by control dynamics, and persistent path-delay differences due to path heterogeneity. These observations motivate a joint design of a multipath controller and a packet scheduler to address transient and persistent delay differences, respectively. We present Rondo, a packet-level multipath transport that achieves both high throughput and low packet reordering. Its multipath controller uses ACK-based per-path capacity estimation and probing to maintain stable path loads, while its packet scheduler adjusts packet transmission order to compensate for persistent delay differences. Testbed experiments and large-scale simulations show that Rondo reduces the maximum out-of-order degree by up to 97.5% while maintaining high throughput. With constrained receiver buffers, Rondo achieves up to 8.51 times higher goodput.
Sources
- Resilient AI Supercomputer Networking using MRC and SRv6
- RNG: Flat Datacenter Networks at Scale
- NVIDIA Spectrum-X: Hardware-Accelerated Multiplane Networking for Large-Scale AI Training
- STrack: A Reliable Multipath Transport for AI/ML Clusters
- ScaleAcross Explorer: Exploring Communication Optimization for Scale-Across AI Model Training
- TENT: A Declarative Slice Spraying Engine for Performant and Resilient Data Movement in Disaggregated LLM Serving
Related papers
- Predicting Networks Before They Happen: Experimentation on a Real-Time V2X Digital Twin
- MultiMoQ: Multi-Access Media-Over-QUIC for Robust Immersive Video Streaming
- HiFiNet: Hierarchical Fault Identification in Wireless Sensor Networks via Edge-Based Classification and Graph Aggregation
- Flux: Optimal Scheduling of Optical Circuit Switches for LLM Training
- Tutorial on Closed-Loop and Application-Aware Digital Twins for Future Wireless Networks
- Claude Code Complete User Handbook