Entangled in Representations: Mechanistic Investigation of Cultural Biases in Large Language Models
The episode reviews a paper investigating how cultural biases are deeply embedded within Large Language Models (LLMs). The hosts discuss tools like Culturescope, which reveals that models exhibit Western-dominance bias and conflate cultures. The conclusion is that fixing these issues requires targeted interventions: untangling knowledge for high-resource cultures and adding data for low-resource ones.