SAE Interprets MoE: Sparse AutoEncoders Reveal That MoE Experts Exhibit Human-Interpretable Fine-Grained Specialization

arXiv:2611.08089 · cs.LG · Submitted 2026-11-05 · Read on arXiv

cs.LG

Submitted: 2026-11-05

Updated: 2026-11-05

Code: https://github.com/Bytedance-Seed/SAE-Interprets-MoE

Terminology

Sources

Related papers