Large Language Model Selection with Limited Annotations
LLM SELECTOR is a framework that efficiently selects which queries to annotate when resources are limited. It uses judge-based annotations and information gain maximization to choose queries that provide the most knowledge about identifying the best Large Language Model for a task, significantly cutting annotation costs.