Continuous-Utility Direct Preference Optimization
cs.LG, cs.AI
Submitted: 2026-01-31
Updated: 2026-10-06
Comments: Accepted to EMNLP 2026
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Abductive Commonsense Reasoning
- Universal Self-Consistency for Large Language Model Generation
- Training Verifiers to Solve Math Word Problems
- RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment
- CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing
- ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving
- Reinforced Self-Training (ReST) for Language Modeling
- Reasoning with Language Model is Planning with World Model
- ORPO: Monolithic Preference Optimization without Reference Model
- V-STaR: Training Verifiers for Self-Taught Reasoners
- Large Language Models Can Self-Improve
- Understanding the Effects of RLHF on LLM Generalisation and Diversity
- Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs
- Solving Quantitative Reasoning Problems with Language Models
- Semi-Supervised Multimodal Multi-Instance Learning for Aortic Stenosis Diagnosis
- Making Large Language Models Better Reasoners with Step-Aware Verifier
- Let's Verify Step by Step
- WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct
- Generative Language Modeling for Automated Theorem Proving
- Toolformer: Language Models Can Teach Themselves to Use Tools
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks