The Endgame of FSDP Communication: Layout-Aware Collectives on Copy Engines, RDMA, and NVSwitch

arXiv:2610.38228 · cs.DC, cs.LG, cs.PF · Submitted 2026-10-28 · Read on arXiv

cs.DC, cs.LG, cs.PF

Submitted: 2026-10-28

Updated: 2026-10-28

Comments: 18 pages, 13 figures, 9 tables

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Related papers