The Alignment Veto: How Safety Training Suppresses Cultural Knowledge in LLMs
Alignment training often suppresses cultural knowledge via an inequitable safety gate, which is termed the alignment veto. This research shows that when models refuse sensitive questions, their internal thoughts align more with human values than their free answers. It distinguishes this suppression from representational bias and suggests prompt engineering can partially address suppression failures.