Beyond Relevance-Centric Retrieval: Rubric-Oriented Document Set Selection and Ranking
The research introduces a complete evaluate-diagnose-optimize framework to improve AI search results by moving beyond simple document relevance scoring. It created SETWISEEVALKIT, a 28K rubric benchmark assessing documents at three levels: individual, set, and global quality. The key innovation is RUBRIC4SETWISE, a training-free method that converts these complex rubrics into selection signals for rerankers.