Verifier Choice is a Benchmark Design Variable: Auditing Structural Counting Evaluation in Text-to-Image Models
cs.CV, cs.LG
Submitted: 2026-11-11
Updated: 2026-11-11
Code: https://github.com/AzusaCat1111/verifier-choice-audit
Terminology
Sources
- Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generation
- GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment
- TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering
- T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generation
- GenEval 2: Addressing Benchmark Drift in Text-to-Image Evaluation
- Holistic Evaluation of Text-To-Image Models
- Evaluating Text-to-Visual Generation with Image-to-Text Generation
- What makes a good metric? Evaluating automatic metrics for text-to-image consistency
- Revisiting Text-to-Image Evaluation with Gecko: On Metrics, Prompts, and Human Ratings
- Qwen-Image Technical Report
- Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformer
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs