From Value Conditioning to Behavioral Shift: Lightweight Value Alignment of LLMs
Researchers fine-tuned open-source LLMs using scalar ratings from value survey questions as the sole tuning signal to shift their internal values. This lightweight method reliably manipulated specific values, leading to measurable changes in how models behaved on both direct surveys and complex, real-world tasks like judging online disputes.