Splitting and Alternating Minimization Methods for Training Orthogonal Deep Feedforward Networks
math.OC
Submitted: 2026-11-11
Updated: 2026-11-11
Code: https://github.com/WANGJiawei000/OrthADMM
Terminology
Sources
- Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
- Exact solutions to the nonlinear dynamics of learning in deep linear neural networks
Related papers
- An Accelerated Proximal Gradient Method for Bures-Wasserstein Space
- FOMTools: Development and AI-Assisted Code Generation for First-Order Methods
- Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise
- Dynamic Service Recommendation with Congestion-Dependent Joining: Near-Optimal and Constant-Factor Approximation Algorithms
- Integrating Learning and Optimization for Open Transport Capacity Pooling under Disruption
- Zeroth-Order Gradient Estimators under Decision-Dependent Noise