Understanding Moral Reasoning Trajectories in Large Language Models: Toward Probing-Based Explainability

The research investigated how large language models think morally by tracking their internal reasoning steps called moral reasoning trajectories. Findings show models frequently switch between ethical frameworks, which makes them vulnerable to attacks. The study proposes a new metric, MRC, to measure this consistency and suggests alignment should focus on improving how frameworks are integrated.

Open the full episode

More from AI Radio