Physics: Benchmarking Foundation Models on University-Level Physics Problem Solving
cs.AI
Submitted: 2025-03-26
Updated: 2026-10-12
Code: https://github.com/yale-nlp/Physics
Terminology
Sources
- Phi-4 Technical Report
- Pixtral 12B
- Yi: Open Foundation Models by 01.AI
- Open-LLM-Leaderboard: From Multi-choice to Open-style Questions for LLMs Evaluation, Benchmark, and Arena
- InternLM2 Technical Report
- Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling
- Training Verifiers to Solve Math Word Problems
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models
- Gemma 2: Improving Open Language Models at a Practical Size
- FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI
- ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools
- The Llama 3 Herd of Models
- OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems
- Mixtral of Experts
- Aria: An Open Multimodal Native Mixture-of-Experts Model
- MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmark
- GPT-4o System Card
- OpenAI o1 System Card
- Humanity's Last Exam
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems