HAPS: Hierarchical LLM Routing with Joint Architecture and Parameter Search
cs.CL
Submitted: 2026-01-09
Updated: 2026-11-07
Code: https://github.com/zihangtian/HAPS
Terminology
Sources
- Qwen Technical Report
- FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance
- AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors
- Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System
- A Unified Approach to Routing and Cascading for LLMs
- Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing
- GraphRouter: A Graph-based Router for LLM Selections
- HyperNetworks
- Measuring Massive Multitask Language Understanding
- RouterBench: A Benchmark for Multi-LLM Routing System
- RouterEval: A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in LLMs
- Mistral 7B
- Universal Model Routing for Efficient LLM Inference
- The Power of Scale for Parameter-Efficient Prompt Tuning
- Prefix-Tuning: Optimizing Continuous Prompts for Generation
- DeepSeek-V3 Technical Report
- Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks
- Routoo: Learning to Route to Large Language Models Effectively
- AdapterHub: A Framework for Adapting Transformers
- IRT-Router: Effective and Interpretable Multi-LLM Routing via Item Response Theory
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data