Query-efficient model evaluation using cached responses
cs.LG, cs.AI, stat.ME
Submitted: 2026-05-08
Updated: 2026-06-04
Journal ref: Proceedings of the 43rd International Conference on Machine Learning (ICML 2026), PMLR 306:42691-42706, 2026
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Consistent estimation of generative model representations in the data kernel perspective space
- Concentration bounds on response-based vector embeddings of black-box generative models
- Scales++: Compute Efficient Evaluation Subset Selection with Cognitive Scales Embeddings
- Evaluating Large Language Models Trained on Code
- On the Measure of Intelligence
- Comparing Foundation Models using Data Kernels
- LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models
- We Should Chart an Atlas of All the World's Models
- The Platonic Representation Hypothesis
- Datamodels: Predicting Predictions from Training Data
- What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams
- Holistic Evaluation of Language Models
- MTEB: Massive Text Embedding Benchmark
- Manifold Matching: Joint Optimization of Fidelity and Commensurability
- A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications
- Instruction Tuning for Large Language Models: A Survey
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis