Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent
math.PR, cs.LG, math.AP, stat.ML
Submitted: 2023-02-14
Updated: 2023-02-14
Terminology
Sources
- Implicit Bias of Gradient Descent for Wide Two-layer Neural Networks Trained with the Logistic Loss
- Conservative SPDEs as fluctuating mean field limits of stochastic gradient descent
- On uniform-in-time diffusion approximation for stochastic gradient descent
- Mean Field Limit of the Learning Dynamics of Multilayer Neural Networks
- Stochastic Particle Gradient Descent for Infinite Ensembles
- Trainability and Accuracy of Neural Networks: An Interacting Particle System Approach
Related papers
- Rank-One HCIZ Integrals and Multiplicative Convolutions
- Markov Chain CLTs: Resolving Open Problems
- Marked stable L'evy processes in Brownian local time
- A Sharp Refinement of Samuels' Inequality via Cap Moves
- A zero-one law for swap-invariant events in uniform spanning forests
- Bernoulli flow for Erd s-R'enyi graphs