Inducing Process Supervision from Outcome-Only Reinforcement Learning
cs.LG, cs.AI
Submitted: 2026-09-29
Updated: 2026-09-29
Code: https://github.com/RUCBM/TIPS
Terminology
Sources
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- AgentCPM-Explore: Realizing Long-Horizon Deep Exploration for Edge-Scale Agents
- Training Verifiers to Solve Math Word Problems
- Process Reinforcement through Implicit Rewards
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- RLHF Workflow: From Reward Modeling to Online RLHF
- DARC: Decoupled Asymmetric Reasoning Curriculum for LLM Evolution
- The Llama 3 Herd of Models
- Measuring Mathematical Problem Solving With the MATH Dataset
- Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning
- ToRL: Scaling Tool-Integrated RL
- DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
- Proximal Policy Optimization Algorithms
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- MiniCPM4: Ultra-Efficient LLMs on End Devices
- OctoThinker: Mid-training Incentivizes Reinforcement Learning Scaling
- J1: Incentivizing Thinking in LLM-as-a-Judge via Reinforcement Learning
- Qwen2.5 Technical Report
- Qwen3 Technical Report
- GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks