Efficient Preconditioned Optimization Methods with Frequent Directions

The authors propose efficient preconditioned optimization methods like FTSL and S-ASGO that accelerate adaptive optimization using frequent directions (FD). They integrate FD with primal-dual frameworks and exploit matrix structures to achieve tighter regret bounds and reduced computational complexity for optimizing both vector and matrix variables.

Open the full episode

More from AI Radio