Fast, Cheap, and Fair? Evaluating Decision Models
cs.AI
Submitted: 2026-11-03
Updated: 2026-11-03
Terminology
Sources
- Monocultural Biases: Correlated biases in large language models lead to unequal systemic exclusion rates in hiring
- Evaluating and Benchmarking the System One Model Jev
- How Reliable Are System-One Decisions in Medicine? A Comparative Study of Jev, Jev-like Models, and LLMs
- Auditing the Use of Language Models to Guide Hiring Decisions
- More Choices, Fewer Decisions: Ordinal-Scale Bias in JEV-like Direct-Decision Models
- Can LLMs Hire Fairly? Racial Bias in Resume Screening
- Just Ask Jev: Reinforcement Learning for Calibrated Decisions as a Zero-Shot Detector of AI Alignment Failures
- Evaluating Decision Models for Text Annotation in Computational Social Science
- Are AI Decision Models Biased? A Case Study of Jev
- Evaluating System One Models for Agent Security Decisions: Reliability, Calibration, and Selective Automation
- Decision Models vs. LLMs as Rubric Judges: Cheaper, Faster, and Wrong in the Same Places
- Type-Safe Is Not Error-Free: Typed Decision Models Follow the Option Name, Not the Definition Bound to It
- Evaluating and Mitigating Discrimination in Language Model Decisions
- Typed Decision Models: An Early Evidence Audit and Evaluation Checklist
- Same Scores, Different Decisions: Evaluating JEV and Language Models for Legal Document Understanding
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents