JuryFlow: Disagreement-Guided Human-in-the-Loop Multi-Agent Evaluation
JuryFlow is a framework that uses multiple AI judges to evaluate content but fixes disagreements instead of ignoring them. It treats judge disagreement as a signal for uncertainty, using a human to select which specific claim needs fixing. This correction propagates through the system, creating reusable rules for future evaluations.