Reinforcement Learning over Predictive Distributions for LLM Regression
Distribution-Aware Reward (DAR) trains language models for regression tasks by treating multiple decoded outputs as a distribution rather than scoring them individually. It uses the Continuous Ranked Probability Score (CRPS) to evaluate this entire set of predictions, rewarding models that produce accurate and well-calibrated predictive distributions, which improves uncertainty estimation.