Differentiable Mixture-of-Agents Incentivizes Swarm Intelligence of Large Language Models
DMoA is a self-evolving multi-agent framework that dynamically routes and activates agents during reasoning based on context. It extends Mixture-of-Agents by allowing agents to be determined at each step, simulating diverse communication topologies. This enables elastic collaboration, adapting agent usage to varying demands for improved performance across complex tasks.