Science Prediction Universe
cs.AI, cs.CL
Submitted: 2026-11-11
Updated: 2026-11-11
Code: https://github.com/harbor-framework/terminal-bench-science
Terminology
Sources
- Language agents achieve superhuman synthesis of scientific knowledge
- MDCrow: Automating Molecular Dynamics Workflows with Large Language Models
- Robin: A multi-agent system for automating scientific discovery
- Humanity's Last Exam
- Agents' Last Exam
- Large language models surpass human experts in predicting neuroscience results
- SciPredict: Can LLMs Predict the Outcomes of Scientific Experiments in Natural Sciences?
- AssayBench: An Assay-Level Virtual Cell Benchmark for LLMs and Agents
- BixBench: a Comprehensive Benchmark for LLM-based Agents in Computational Biology
- DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
- Long-Horizon-Terminal-Bench: Testing the Limits of Agents on Long-Horizon Terminal Tasks with Dense Reward-Based Grading
- Biology-in-the-loop: Amortized Adaptive Hit Discovery in CRISPR Screens
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
- DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressively
- AlphaEvolve: A coding agent for scientific and algorithmic discovery
- SciAgentGym: Benchmarking Multi-Step Scientific Tool-use in LLM Agents
- SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?
- PaperBench: Evaluating AI's Ability to Replicate AI Research
- RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents