CultureMERT: Continual Pre-Training for Cross-Cultural Music Representation Learning
The episode discusses CultureMERT, a paper that adapts an existing music model to understand Greek, Turkish, and Indian music using a two-stage continual pre-training strategy. The team also explored task arithmetic for merging single-culture models. The results show improved performance on non-Western music while maintaining performance on Western benchmarks.