Fast Catch-Up, Late Switching: Optimal Batch Size Scheduling via Functional Scaling Laws

arXiv:2602.14208 · cs.LG, cs.AI, cs.CL, math.OC, stat.ML · Submitted 2026-02-15 · Read on arXiv

cs.LG, cs.AI, cs.CL, math.OC, stat.ML

Submitted: 2026-02-15

Updated: 2026-02-23

Code: https://github.com/karpathy/nanoGPT

Terminology

Sources

Related papers