Is Peer Review Really in Decline? Analyzing Review Quality across Venues and Time
The study introduced a new framework to measure review quality across AI and machine learning conferences (ICLR, NeurIPS, ACL) using a multi-dimensional schema: substantiveness, actionability, and grounding. By unifying diverse review formats using LLMs, the research analyzed measurements over time. The key finding is that there is no consistent decline in median review quality across venues and years.