Provisioning to Runtime Optimization of a 100 MW-Scale AI Cluster

Name: Provisioning to Runtime Optimization of a 100 MW-Scale AI Cluster
Uploaded: 2026-10-05T14:42:35.372893+00:00
Duration: 652 s
Description: This work details end-to-end power management for a 150 MW AI cluster using 83K GB200 GPUs. It optimizes performance-per-watt across planning, deployment, and runtime. The findings show that setting GPU power limits around 1000W maximizes overall throughput within the fixed budget, improving efficiency over maximizing individual GPU performance.

This work details end-to-end power management for a 150 MW AI cluster using 83K GB200 GPUs. It optimizes performance-per-watt across planning, deployment, and runtime. The findings show that setting GPU power limits around 1000W maximizes overall throughput within the fixed budget, improving efficiency over maximizing individual GPU performance.

Open the full episode