Is Jev a Good Multilingual Judge?
cs.CL
Submitted: 2026-11-11
Updated: 2026-11-11
Terminology
Sources
- Evaluating and Benchmarking the System One Model Jev
- Specialized Decision Models vs. General-Purpose LLMs: Benchmarking Jev Across Knowledge, Reasoning, and Multilingual Tasks
- JEV-as-a-Judge: Accept When Confident, Escalate When Unsure
- Decision Models vs. LLMs as Rubric Judges: Cheaper, Faster, and Wrong in the Same Places
- MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Models
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data