LitReview Arena: Evaluating Literature Review Agents with Battle-Style Peer Review Platform
The study introduces LitReview Arena, a battle-style evaluation platform for literature review agents using expert judgments to assess quality. It established a benchmark, LitReviewBench, based on expert preferences across five dimensions like structure and research suggestions. Results show state-of-the-art models struggle with these complex aspects compared to humans, suggesting future agents need better conceptual coherence and gap identification.