OptiSelect: How does the Optimizer Shape Data Curriculum?

cs.LG, cs.AI

Submitted: 2026-10-02

Updated: 2026-10-02

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Sources

• Scalable Second Order Optimization for Deep Learning
• Old Optimizer, New Norm: An Anthology
• Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
• Variance-Adaptive Muon: Pre-Orthogonalization Variance Modulation for Efficient Language Model Pretraining
• Online Batch Selection for Faster Training of Neural Networks
• Benchmarking Optimizers for Large Language Model Pretraining
• LLaMA: Open and Efficient Foundation Language Models

Related papers

• Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
• AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
• Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
• Convergence issues in Relational Concept Analysis based on AOC-posets
• Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
• Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks