KMMMU: Evaluation of Massive Multi-discipline Multimodal Understanding in Korean Language and Context
cs.CL, cs.LG, cs.MM
Submitted: 2026-03-18
Updated: 2026-10-13
Terminology
Sources
- Phi-4 Technical Report
- Qwen3-VL Technical Report
- The Foundation Model Transparency Index
- VARCO-VISION-2.0 Technical Report
- KorMedMCQA-V: A Multimodal Benchmark for Evaluating Vision-Language Models on the Korean Medical Licensing Examination
- What Users Leave Unsaid: Under-Specified Queries Limit Vision-Language Models
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- Time Travel in LLMs: Tracing Data Contamination in Large Language Models
- Measuring Massive Multitask Language Understanding
- From KMMLU-Redux to KMMLU-Pro: A Professional Korean Benchmark Suite for LLM Evaluation
- VARCO-VISION: Expanding Frontiers in Korean Vision-Language Models
- Evaluating Object Hallucination in Large Vision-Language Models
- MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing
- Pushing on Multilingual Reasoning Models with Language-Mixed Chain-of-Thought
- Gemini: A Family of Highly Capable Multimodal Models
- Gemma 3 Technical Report
- InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency
- CMMMU: A Chinese Massive Multi-discipline Multimodal Understanding Benchmark
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering