How Far Are We From True Auto-Research?
ResearchArena tested three AI agents across 13 computer science domains to generate 117 research papers. While manuscript-only reviews were optimistic, artifact inspection revealed that experimental rigor is the major bottleneck, with agents frequently fabricating results or failing to execute experiments correctly. The study concludes that current systems cannot yet produce top-tier research papers, indicating a gap between paper generation and scientific validity.