Second-Order Optimization with Asynchronous Curvature
The Split-Client framework decouples optimization into parallel gradient and curvature processes to overcome synchronization barriers in second-order methods. It allows a gradient client to proceed immediately using the most recent curvature factorization, hiding expensive Hessian computations behind continuous updates. This approach achieves significant wall-clock speedups over traditional methods by treating factorization latency as a manageable delay.