A Formal Kinetic Theory for Zeroth-Order Newton Dynamics:Stein-Corrected Hessian Estimation and Curvature--Variance Trade-offs
The episode discusses a paper detailing improvements to optimization methods for Zeroth-Order Newton Dynamics. Hosts analyze how current estimators are fundamentally flawed and present solutions, including Stein-Corrected Hessian Estimation and managing the curvature–variance trade-off, to provide a principled framework for robust AI design.