H-ARC: A Robust Estimate of Human Performance on the Abstraction and Reasoning Corpus Benchmark
cs.AI
Submitted: 2024-09-02
Updated: 2024-09-02
Project page: https://arc-visualizations.github.io
Terminology
Sources
- GPT-4 Technical Report
- On the Measure of Intelligence
- Comparing Humans, GPT-4, and GPT-4V On Abstraction and Reasoning Tasks
- The ConceptARC Benchmark: Evaluating Understanding and Generalization in the ARC Domain
- Hypothesis Search: Inductive Reasoning with Language Models
- Emergent Abilities of Large Language Models
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents