Quantifying the Gap between Understanding and Generation within Unified Multimodal Models
The GAPEVAL benchmark measures the gap between how Unified Multimodal Models understand and generate information. It tests models across four task categories—Instruction Following, Numerical Perception, World Knowledge, and Reasoning—using a Gap Score metric based on MIRT. Findings show current models achieve surface-level unification rather than deep cognitive convergence.