RubricReviewer: From Direct Critique to Rubric-Driven Review via Agentic Evidence Synthesis and Human-Aligned Generation
cs.CL, cs.AI
Submitted: 2026-06-04
Updated: 2026-11-16
Terminology
Sources
- HealthBench: Evaluating Large Language Models Towards Improved Human Health
- MARG: Multi-Agent Review Generation for Scientific Papers
- ReviewAgents: Bridging the Gap Between Human and AI-Generated Paper Reviews
- Reviewer2: Optimizing Review Generation Through Prompt Generation
- ScholarPeer: A Context-Aware Multi-Agent Framework for Automated Peer Review
- Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domains
- Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews
- ReviewGrounder: Improving Review Substantiveness with Rubric-Guided, Tool-Integrated Agents
- OpenRubrics: Towards Scalable Synthetic Rubric Generation for Reward Modeling and LLM Alignment
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- Learning Query-Specific Rubrics from Human Preferences for DeepResearch Report Generation
- HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models
- DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Research
- ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agents
- Reinforcing Chain-of-Thought Reasoning with Self-Evolving Rubrics
- Checklists Are Better Than Reward Models For Aligning Language Models
- DeepReviewer 2.0: A Traceable Agentic System for Auditable Scientific Peer Review
- Auto-Rubric: Learning From Implicit Weights to Explicit Rubrics for Reward Modeling
- Alternating Reinforcement Learning for Rubric-Based Reward Modeling in Non-Verifiable LLM Post-Training
- Chasing the Tail: Effective Rubric-based Reward Modeling for Large Language Model Post-Training
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data