EvE: An Alternate Optimizer to Adam
cs.LG, cs.NE
Submitted: 2026-09-28
Updated: 2026-09-28
Code: https://github.com/tatsu-lab/stanford_alpaca
Terminology
Sources
- Training Verifiers to Solve Math Word Problems
- Neural Architecture Search: A Survey
- LoRA: Low-Rank Adaptation of Large Language Models
- Adam: A Method for Stochastic Optimization
- On the Variance of the Adaptive Learning Rate and Beyond
- Decoupled Weight Decay Regularization
- Adaptive Gradient Methods with Dynamic Bound of Learning Rate
- Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization
- Qwen2.5 Technical Report
- On the Convergence of Adam and Beyond
- Evolution Strategies as a Scalable Alternative to Reinforcement Learning
- Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning
- ADADELTA: An Adaptive Learning Rate Method
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks