Inverse RL Helps Align AI by Imitating Humans
PARED recovers an explicit reward signal from expert demonstrations by constraining reward inference to a small set of features. This allows AI models to be aligned by using this recovered reward for real-time selection during inference or for training the model on-policy, moving beyond simple supervised fine-tuning.