DramaGrow: A Regime-Aware Benchmark for Auditing LLM Judges of Multi-Episode Drama
cs.CL, cs.AI
Submitted: 2026-10-14
Updated: 2026-10-14
Terminology
Sources
- From Rubrics to Reliable Scores: Evidence-Grounded Text Evaluation with LLM Judges
- GrowLoop: Self-Evolving Conversation Evaluation Seeded by Human
- DramaBench: A Six-Dimensional Evaluation Framework for Drama Script Continuation
- Online Rubrics Elicitation from Pairwise Comparisons
- Auto-Rubric: Learning From Implicit Weights to Explicit Rubrics for Reward Modeling
- Feedback-to-Rubrics: Can We Learn Expert Criteria from Inline Comments?
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data