On the Role of Citations in Preference Data
The study compared human and LLM judges' preferences regarding citations in scientific question answering using mixed-effects models. Findings show that humans prefer more diverse but fewer total citations, while LLMs show similar but stronger preferences for diversity. This suggests both humans and AI benefit from better citation guidance during evaluation.