Scaling Machine Learning Interatomic Potentials with Mixtures of Experts
The episode discusses a paper scaling machine learning interatomic potentials using Mixtures of Experts. The hosts explain how this method uses smaller 'expert' networks routed by an element-wise mechanism to achieve better accuracy and efficiency than dense models. Key findings include improved performance, structural organization mirroring the periodic table, and a recipe for scaling atomistic simulations.