S1CogBench: What System One Decision Models Can and Cannot Do on Cognitive Experiments
cs.CL, cs.AI, q-bio.NC
Submitted: 2026-10-31
Updated: 2026-11-14
Code: https://github.com/dengzhe-hou/S1CogBench
Terminology
Sources
- System1-Arena: Which Decisions Can Be Left to System 1?
- The Llama 3 Herd of Models
- WMIP: A Working-Memory-Inspired Programmable Probe of Cumulative State Tracking in Large Language Models
- CogBattery: Human-Referenced Evaluation of Cognitive Task Behavior and Structure in Language Models
- DecisionRobust: Benchmarking Robustness for JEV Style Decision Models Across Text and Vision
- Not Yet AlphaFold for the Mind: Evaluating Centaur as a Synthetic Participant
- Benchmarking System One decision models against trained classifiers and language models for automated decision gates
- TypedBench: A Benchmark for Calibration, Framing Sensitivity, and Cost in System One Decision Models
- Type-Safe Is Not Error-Free: Typed Decision Models Follow the Option Name, Not the Definition Bound to It
- Shopping by algorithm: How agentic AI deploys human heuristics as a surrogate consumer
- CogGym: Towards Large-Scale Comparative Evaluation of Human and Machine Cognition
- Intern-Decision: Efficient Multimodal Decision Making with Autoregressive Masked Language Modeling
- DecisionPivot: A Diagnostic Benchmark for Decision Models in LLM Systems
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data