Ranking Agreement Does Not Reveal Paragraph-Edit Agreement in Two Released Paper Acceptance Predictors
cs.CL, cs.LG
Submitted: 2026-11-04
Updated: 2026-11-04
Code: https://github.com/nbbllxx0/Ranking-Agreements
Terminology
Sources
- Phi-4 Technical Report
- Has the Machine Learning Review Process Become More Arbitrary as the Field Has Grown? The NeurIPS 2021 Consistency Experiment
- Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment
- Contrastive Residual Energy Test-time Adaptation
- PaperScorer: How Predictable Is Paper Acceptance?
- What Can Natural Language Processing Do for Peer Review?
- AutoSupervision: Closing the Feedback Loop in Scientific Workflows with Grounded Revision Verification
- Gaming AI-Assisted Peer Reviews Poses New Risks to the Scientific Community
- How Can Rhetoric Reward-Hack AI Reviewers? Dissecting Rhetorical Sensitivity in AI-Based Peer Review
- Categorizing Variants of Goodhart's Law
- Counterfactual LLM-based Framework for Measuring Rhetorical Style
- Qwen2.5 Technical Report
- Large Language Models are Inconsistent and Biased Evaluators
- The Space of Transferable Adversarial Examples
- A Missing Piece for Trustworthy AI Reviewers: From Benchmarking Rhetorical Robustness to SciCore Review
- The Rank and Gradient Lost in Non-stationarity: Sample Weight Decay for Mitigating Plasticity Loss in Reinforcement Learning
- No Hidden Prompts Needed! You Can Game AI Peer Review with Presentation-Only Revisions
- Can We Believe AI Peer Review?
- Fine-Tuning Language Models from Human Preferences
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data