Agreement Is Not Alignment: Divergent Moral Grounds in Human and LLM Ethical Judgments
The episode discusses the paper "Agreement Is Not Alignment," which argues that simply matching human answers on moral questions does not prove a model understands ethics. The authors found that while LLMs achieved high label agreement, their underlying moral reasoning (or 'moral grounds') systematically diverged from human thought, necessitating rationale-aware evaluation for trust and safety.