Benchmark-Driven Selection of AI: Evidence from DeepSeek-R1
The study investigates whether better reasoning performance in large language models comes from test-time fixes or using impactful benchmarks as learning curricula. Using DeepSeek-R1, the researchers found that training with specific tasks like Humanity's Last Exam improves performance more than general post-training optimizations, suggesting benchmark selection is a key driver for generalization.