Carefully Considering Culture: Analyzing LLM Alignment in Single- and Multi-Cultural Settings using Cultural Consensus Theory
The episode analyzes a paper using Cultural Consensus Theory to test how well LLMs understand human culture. Hosts discuss that models often fail by either failing to find consensus, creating false consensus, or being overly rigid (homogenization). They conclude that testing the structure of agreement is crucial for responsible AI development.