MHR-Router: Multimodal Heterogeneous Retrieval-Enhanced Adaptive Routing for VLM Inference
MHR-Router proposes a method to adaptively route queries to the best Vision-Language Model (VLM) expert using multimodal evidence. It creates a combined image and text query representation, then uses expert success and failure memories to retrieve local evidence for each expert. This allows for accurate, input-dependent routing without needing prior labels during inference.