Understanding Moral Reasoning Trajectories in Large Language Models: Toward Probing-Based Explainability
The research investigated how large language models think morally by tracking their internal reasoning steps called moral reasoning trajectories. Findings show models frequently switch between ethical frameworks, which makes them vulnerable to attacks. The study proposes a new metric, MRC, to measure this consistency and suggests alignment should focus on improving how frameworks are integrated.