Rubrics on Trial: Evolving Rubrics from a Single Query via Synthetic Pairwise Evidence
RUBRICS ON TRIAL is a query-only framework that automatically evolves a set of evaluation rubrics from an empty state. It generates supervision by creating synthetic response pairs and validates each proposed rubric against these pairs before adding it. This process screens out poor or style-only rubrics, leading to high-quality, query-specific evaluation criteria.