Cultural Counterfactuals: Evaluating Cultural Biases in Large Vision-Language Models with Counterfactual Examples
This study created a synthetic dataset using image editing to test how Large Vision-Language Models (LVLMs) respond to cultural context, such as religion and nationality. The research found that LVLMs show significant biases based on these contexts, leading to disproportionate toxicity scores in specific cultural settings. This highlights the need for careful model selection and holistic bias evaluation.