Learning Latent Reasoning Traces for Scalar Reward Models End-to-End
Sanwoo Lee, Clive Bai, Hsiu-Yuan Huang, Kun Liang, Weijie Liu, Yunfang Wu
cs.CL
Submitted: 2026-07-31
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Critique-out-Loud Reward Models
- Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
- PaTaRM: Bridging Pairwise and Pointwise Signals via Preference-Aware Task-Adaptive Reward Modeling
- Skywork-Reward: Bag of Tricks for Reward Modeling in LLMs
- Inference-Time Scaling for Generalist Reward Modeling
- AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning dataset
- Proximal Policy Optimization Algorithms
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- Qwen3 Technical Report
- Fine-Tuning Language Models from Human Preferences
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering