EMPATH: A Multilingual Auditor-Judge Benchmark for Safety Evaluation of Emotional-Support Chatbots
cs.AI, cs.CY
Submitted: 2026-06-29
Updated: 2026-06-29
Code: https://github.com/camilochs/empath-benchmark
Terminology
Sources
- HealthBench: Evaluating Large Language Models Towards Improved Human Health
- PsyEval: A Suite of Mental Health Related Tasks for Evaluating Large Language Models
- Building Trust in Mental Health Chatbots: Safety Metrics and LLM-Based Evaluation Tools
- Language Shapes Mental Health Evaluations in Large Language Models
- MHSafeEval: Role-Aware Interaction-Level Evaluation of Mental Health Safety in Large Language Models
- Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBench
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
- LLM Evaluators Recognize and Favor Their Own Generations
- Towards Understanding Sycophancy in Language Models
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents