COMPREHEND: Ultra-Fine-Grained Benchmark Understanding by Entailment Hierarchy
cs.CL
Submitted: 2026-11-03
Updated: 2026-11-03
Code: https://github.com/JackNapier20/COMPREHEND_public
Terminology
Sources
- ErrorMap and ErrorAtlas: Charting the Failure Landscape of Large Language Models
- PROMPT2BOX:Improving LLM Weakness Discovery and Specificity Estimation by Uncovering Entailment Structure among Prompts
- Walking Down the Memory Maze: Beyond Context Limit through Interactive Reading
- Prompt-to-Leaderboard
- Science Hierarchography: Hierarchical Organization of Science Literature
- LLM-guided Hierarchical Search for End-to-end Reasoning Intensive Retrieval
- Retrieval-Augmented Generation with Hierarchical Knowledge
- Trust by Design: Skill Profiles for Transparent, Cost-Aware LLM Routing
- Clio: Privacy-Preserving Insights into Real-World AI Use
- SkillVerse : Assessing and Enhancing LLMs with Tree Evaluation
- EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Trees
- Skill-Aware Data Selection and Fine-Tuning for Data-Efficient Reasoning Distillation
- Hierarchical Abstract Tree for Cross-Document Retrieval-Augmented Generation
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data