When Chekhov's Gun Fires Anyway: Over-Realization in Text-to-Image Models
cs.CV, cs.AI
Submitted: 2026-11-12
Updated: 2026-11-12
Code: https://github.com/black-forest-labs/flux
License: http://creativecommons.org/licenses/by/4.0/
The gist: In text-to-image generation, a target that the prompt mentions often appears in the generated image in a way the prompt does not call for.
Abstract
In text-to-image generation, a target that the prompt mentions often appears in the generated image in a way the prompt does not call for. We call this failure over-realization. Mental-spaces theory points to the situations where it can happen: under a negation, inside what a character believes or imagines, as the vehicle of a figurative comparison, or behind a viewpoint that hides the target. Prior work has studied only negation in depth, and the conventional alignment and preference metrics do not penalize the failure. We build OverReal to measure it: OverReal-Gen, 698 prompts covering the four situations, on which we measure each generator's over-realization rate; and OverReal-Det, 2,841 generated images human-labeled for whether and how the target is over-realized, on which we verify the automatic judge that produces this rate. Our evaluation of eight text-to-image systems reveals that all of them over-realize, and that conventional metrics such as CLIPScore reward the failure rather than penalize it. Prompt expansion only partly mitigates the failure. Inside the generator, the diffusion backbone attends to a mentioned target almost as much as to a requested one. The cue words that should hold the target back receive less attention than ordinary words.
Sources
- Qwen2.5-VL Technical Report
- TNG-CLIP:Training-Time Negation Data Generation for Negation Awareness of CLIP
- Relations, Negations, and Numbers: Looking for Logic in Generative Text-to-Image Models
- Hallucination as an Upper Bound: A New Perspective on Text-to-Image Evaluation
- Evaluating Hallucination in Text-to-Image Diffusion Models with Scene-Graph based Question-Answering Agent
- Qwen-Image Technical Report
- T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation
- OmniGen2: Towards Instruction-Aligned Multimodal Generation
- Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs