ARoute: Task-Aligned Batch and Streaming Model Routing
cs.DB
Submitted: 2026-11-09
Updated: 2026-11-09
Terminology
Sources
- AutoMix: Automatically Mixing Language Models
- The Design of an LLM-powered Unstructured Analytics System
- Conformal Risk Control
- Text2SQL is Not Enough: Unifying AI and Databases with TAG
- FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance
- RouterDC: Query-Based Router by Dual Contrastive Learning for Assembling Large Language Models
- Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing
- BEST-Route: Adaptive LLM Routing with Test-Time Optimal Compute
- GraphRouter: A Graph-based Router for LLM Selections
- A Note on the Chernoff Bound for Random Variables in the Unit Interval
- Efficient LLM Scheduling by Learning to Rank
- Selective Classification for Deep Neural Networks
- The Llama 3 Herd of Models
- Smoothie: Label Free Language Model Routing
- Language Model Cascades: Token-level uncertainty and beyond
- RouterBench: A Benchmark for Multi-LLM Routing System
- LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
- LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusion
- S$^{3}$: Increasing GPU Utilization during Generative Inference for Higher Throughput
- When Does Confidence-Based Cascade Deferral Suffice?
Related papers
- Beyond Overlap: Hierarchical Graph Abstraction for Out-of-Core Vector Search
- EMA: Approximate Nearest Neighbor Search with General Attribute Filtering and Dynamic Updates
- Open Biomedical Knowledge Graphs at Scale: Construction, Federation, and AI Agent Access with Samyama Graph Database
- Samyama: A Unified Graph-Vector Database with In-Database Optimization, Agentic Enrichment, and Hardware Acceleration
- GenTUS: Table Union Search via Constrained Generation of Semantic Table Identifiers
- Common-Neighbor-Count-Based Representative Possible World Finding on Uncertain Graphs