Beyond Proxy Metrics: MLLMs as Human Surrogates for Explainable AI Evaluation
cs.AI
Submitted: 2026-11-10
Updated: 2026-11-10
Code: https://github.com/EoinKenny/MLLM_Human_Surrogates
Terminology
Sources
- Towards A Rigorous Science of Interpretable Machine Learning
- A survey on Concept-based Approaches For Model Improvement
- Metrics for Explainable AI: Challenges and Prospects
- If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniques
- Auditing language models for hidden objectives
- Bridging the Human-AI Knowledge Gap: Concept Discovery and Transfer in AlphaZero
- Reassessing Evaluation Functions in Algorithmic Recourse: An Empirical Study from a Human-Centered Perspective
- Daily and Weekly Periodicity in Large Language Model Performance and Its Implications for Research
- Synthetic Heuristic Evaluation: A Comparison between AI- and Human-Powered Usability Evaluation
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents