RankShift: Evaluating Ranking Instability Across Benchmark Dimensions in Document Parsing
cs.AI
Submitted: 2026-11-07
Updated: 2026-11-07
Terminology
Sources
- When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards
- Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decoding
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- PaddleOCR-VL-1.5: Towards a Multi-Task 0.9B VLM for Robust In-the-Wild Document Parsing
- The Benchmark Lottery
- GLM-OCR Technical Report
- Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation
- Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting
- HunyuanOCR Technical Report
- Quantifying Ranking Instability Across Evaluation Protocol Axes in Gene Regulatory Network Benchmarking
- Efficient Memory Management for Large Language Model Serving with PagedAttention
- SafetyRepro: Configuration-Conditional Rank Instability on Alignment Benchmarks
- dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Model
- MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarios
- MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigm
- Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers
- MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing
- olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Models
- Benchmark^2: Systematic Evaluation of LLM Benchmarks
- MinerU2.5-Pro: Pushing the Limits of Data-Centric Document Parsing at Scale
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents