ANCORA: Learning to Question via Manifold-Anchored Self-Play for Verifiable Reasoning
cs.LG, cs.AI, cs.PL
Submitted: 2026-04-30
Updated: 2026-11-09
Terminology
Sources
- Tool-R0: Self-Evolving LLM Agents for Tool-Learning from Zero Data
- AlphaVerus: Bootstrapping Formally Verified Code Generation through Self-Improving Translation and Treefinement
- Program Synthesis with Large Language Models
- Self-Questioning Language Models
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
- STP: Self-play LLM Theorem Provers with Iterative Conjecturing and Proving
- REINFORCE++: Stabilizing Critic-Free Policy Optimization with Global Advantage Normalization
- Qwen2.5-Coder Technical Report
- Learning to Solve and Verify: A Self-Play Framework for Code and Test Generation
- SPICE: Self-Play In Corpus Environments Improves Reasoning
- Understanding R1-Zero-Like Training: A Critical Perspective
- OpenAI o1 System Card
- DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition
- Proximal Policy Optimization Algorithms
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- HybridFlow: A Flexible and Efficient RLHF Framework
- Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm
- Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
- Teaching Models to Teach Themselves: Reasoning at the Edge of Learnability
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis