CopRoute: Dependence-Aware Conformal Routing for Language Models
CopRoute addresses limitations in existing model routing by ignoring how model failures depend on each other. It proposes a new method that orders models based on how many new queries they can correctly answer, adapts selection per query, and sets the smallest cutoff to control risk. This results in significantly fewer inference calls while maintaining a guaranteed level of all-miss risk across various language model setups.