Gated Against One Model, Open to the Next: Option-Only Solvability in Legal Multiple-Choice Benchmarks
cs.CL, cs.AI, cs.CY
Submitted: 2026-08-15
Updated: 2026-11-01
Terminology
Sources
- LEXam: Benchmarking Legal Reasoning on 340 Law Exams
- CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review
- The Cambridge Law Corpus: A Dataset for Legal AI Research
- Shortcut Learning in Legal Judgment Prediction: Empirical Evidence from the UK Employment Tribunal
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data