Towards Better Training Signal: Advantage Clipped Policy Optimization

cs.LG

Submitted: 2026-09-29

Updated: 2026-09-29

Code: https://github.com/huggingface/Math-Verify

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Sources

• Online Difficulty Filtering for Reasoning Oriented Reinforcement Learning
• The Entropy Mechanism of Reinforcement Learning for Reasoning Language Models
• OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems
• Measuring Mathematical Problem Solving With the MATH Dataset
• Group Adaptive Clipping Policy Optimization
• Tulu 3: Pushing Frontiers in Open Language Model Post-Training
• All-Quadrant Bounded Clipping GRPO: Closing the Unbounded Blind Spot for Stable and Generalizable Training
• MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention
• Proximal Policy Optimization Algorithms
• Bellman Policy Optimization
• Reinforce-Ada: An Adaptive Sampling Framework under Non-linear RL Objectives
• Mastering Complex Control in MOBA Games with Deep Reinforcement Learning
• DAPO: An Open-Source LLM Reinforcement Learning System at Scale
• SPEED-RL: Faster Training of Reasoning Models via Online Curriculum Learning
• Group Sequence Policy Optimization

Related papers

• Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
• AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
• Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
• Convergence issues in Relational Concept Analysis based on AOC-posets
• Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
• Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks