Evaluating Jev on Arabic: Comparing Decision Models and LLMs Across Arabic Tasks and Dialects
cs.CL, cs.AI
Submitted: 2026-11-07
Updated: 2026-11-12
Code: https://github.com/alexa/massive
Terminology
Sources
- Evaluating and Benchmarking the System One Model Jev
- AraTrust: An Evaluation of Trustworthiness for LLMs in Arabic
- Is this sentence valid? An Arabic Dataset for Commonsense Validation
- Automated essay scoring in Arabic: a dataset and analysis of a BERT-based system
- CARE: Multilingual Human Preference Learning for Cultural Awareness
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data