Detecting a Route Flip Is Easier Than Knowing Whether to Fix It: Causal Route-Mediated Damage in Quantized Mixture-of-Experts

Name: Detecting a Route Flip Is Easier Than Knowing Whether to Fix It: Causal Route-Mediated Damage in Quantized Mixture-of-Experts
Uploaded: 2026-08-20T15:50:19.466349+00:00
Duration: 542 s
Description: The episode discusses a paper analyzing causal route-mediated damage in quantized Mixture-of-Experts (MoE) models. Hosts explain that while one can detect when a model's router 'flips' due to memory compression, determining if that flip is beneficial or harmful remains impossible, presenting a key challenge for model repair.

The episode discusses a paper analyzing causal route-mediated damage in quantized Mixture-of-Experts (MoE) models. Hosts explain that while one can detect when a model's router 'flips' due to memory compression, determining if that flip is beneficial or harmful remains impossible, presenting a key challenge for model repair.

Open the full episode