UniPool: Learning Expert-to-Layer Ownership from Brief Global Access
UNIPOOL replaces layer-private expert sets with a single global shared pool accessed by independent routers. This architecture uses NormRouter for stable routing and a pool-level auxiliary loss to manage load balancing across layers. The research shows this approach improves performance while allowing expert parameters to scale sublinearly with model depth.