DreamRealm: Exploring and Materializing Hallucination Worlds for Trustworthy Vision-Language Models

arXiv:2611.06433 · cs.CV · Submitted 2026-11-04 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "DreamRealm: Exploring and Materializing Hallucination Worlds for Trustworthy Vision-Language Models".

Jane: Here's the gist of the paper. Multimodal large language models (MLLMs) remain prone to visual hallucinations when correct responses depend on subtle visual details.

Tom: DreamRealm is a post-training framework that explores diverse latent hallucinated responses, minimally edits original images to make them valid, and trains the model to assign each response to its supporting image.

Jane: Pruning redundant reasoning tokens The authors introduce DreamRealm as a post-training framework centered on matching hallucinated responses to their supporting images.

Tom: This framework consists of RealmForgePipe, a data pipeline for exploring and materializing a model’s own hallucinations, and RealmMatch, which learns image–response correspondence.

Title and authors: Tom: So, DreamRealm: Exploring and Materializing Hallucination Worlds for Trustworthy Vision-Language Models. That title suggests they are building these 'hallucination worlds' to make models trustworthy, which is a pretty big goal in vision-language AI right now.

Jane: It sounds like they are trying to move beyond just fixing the wrong answers and instead teach the model *why* it got confused in the first place.

Lu: The paper suggests that by materializing these conditions—the visual setups that would actually make a hallucinated response valid—they can better supervise the model's understanding of fine-grained visual changes <ref:2611.06433#pg2>.

Meng: But materializing those worlds requires a lot of data. How much manual work are we talking about to create these edited images?

Lalam: They build something called the Realized Hallucination Dataset, which they call RealmSet, by mining hallucinations from Qwen3 point 5-9B and creating around twenty-eight thousand nine hundred sixty human-approved edited examples spanning twenty-two perceptual question categories <ref:2611.06433#pg3>.

Tom: twenty-eight thousand examples is a solid dataset size for this kind of fine-tuning, especially since they're focusing on Qwen3 point 5-9B as their target model <ref:2611.06433#pg2>.

Jane: So, instead of just showing the model the wrong answer and the right answer, they are showing it a whole world where that wrong answer actually makes sense visually <ref:2611.06433#pg2>.

Lu: Exactly. They’re trying to capture those perceptual confusions directly from what the model is already doing when it hallucinates <ref:2611.06433#pg2>.

Meng: If we can use the model's own mistakes to create training data, that bypasses some of our need for perfectly curated human annotations, which is a plus for production pipelines.

Lalam: The framework includes RealmMatch, which builds a likelihood score matrix by cross-pairing original and materialized images with candidate responses <ref:2611.06433#pg3>.

Tom: So, the mechanism involves finding these latent hallucinations first, then creating the valid visual conditions around them, and finally training a matching module to connect the two.

Jane: That sounds like an iterative process where they are using their own model's confusion as the primary source of supervision <ref:2611.06433#pg2>.

The paper's summary: Tom: So, what does the abstract actually say about how this works? It seems to contrast existing methods that correct responses under fixed images with their approach that focuses on the image input side of supervision <ref:2611.06433#pg1>.

Jane: They are inspired by how humans correct misconceptions, like telling a child a tablet is medicine instead of candy, and they try to replicate that process for AI <ref:2611.06433#pg2>.

Lu: The key is that they derive image-editing targets directly from observed and mined latent hallucinations to construct these visual conditions <ref:2611.06433#pg3>.

Meng: So, if the model hallucinates something, they find what visual changes would make that hallucination look real in a different context, and then they train the model to link that specific response to those specific edited images.

Lalam: They use a joint training objective called Ledit which combines image-conditioned response contrast loss and response-conditioned image contrast loss along with standard supervised fine-tuning <ref:2611.06433#pg3>.

Tom: I see they are using bidirectional contrastive losses, one row-wise to favor the matching response over others in a family, and one column-wise to favor the supporting image for each response <ref:2611.06433#pg3>.

Jane: That's clever because it forces the model to learn not just what the right answer is, but *which specific visual context* supports that answer <ref:2611.06433#pg2>.

Lu: The paper claims this approach is a promising paradigm for both improving visual perception and mitigating hallucinations across six different benchmarks <ref:2611.06433#pg3>.

Meng: Six benchmarks is good, but the real question is how robust this training signal is when you move to real-world traffic where the model isn't just dealing with clean Qwen test data.

Lalam: They showed gains of seven point two six percentage points in HallusionBench accuracy and eleven point three four percentage points in MMVP pair accuracy on Qwen3 point 5-9B <ref:2611.06433#pg3>.

The paper's improvements: Tom: They don't just present the framework, they show that the RealmForgePipe data construction pipeline, RealmSet, derived from Qwen3 point 5-9B hallucinations <ref:2611.06433#pg3>, is actually very effective at aligning training data with perceptual confusions <ref:2611.06433#pg2>.

Jane: The ablation studies are interesting because they show that targeting observed errors helps improve five of seven metrics over unguided editing, which suggests the targeted approach is better than just random editing <ref:2611.06433#pg3>.

Lu: And adding latent hallucinations improves all seven metrics over just using the observed ones, which proves that mining those hidden confusions is valuable <ref:2611.06433#pg3>.

Meng: So, if I'm deploying this, the ablation results tell me that focusing on the specific errors we see in our logs pays off more than just letting the model guess what a random edit would fix.

Lalam: They also compare DreamRealm against other specialized hallucination-mitigation methods like VCD and CoCI-CAP, and when training on its own hallucinations, DreamRealm improves all seven metrics over the corresponding base model <ref:2611.06433#pg3>.

Tom: The largest gains they report are actually on Qwen3 point 5-9B, which is interesting because it shows the method scales well with larger models <ref:2611.06433#pg2>.

Jane: It really puts it in perspective that hallucination assignment could be a solid way to improve how we perceive images, not just how accurately we answer questions about them <ref:2611.06433#pg3>.

Conclusion: Tom: So to wrap up, the paper on "DreamRealm: Exploring and Materializing Hallucination Worlds for Trustworthy Vision-Language Models" suggests that by materializing hallucination worlds, we can teach models a better way to match responses to visual conditions <ref:2611.06433#pg2>.

Jane: The implication is that this method of supervision, focusing on the model's own confusions rather than just fixing errors under fixed images, is promising for making vision-language models more trustworthy <ref:2611.06433#pg1>.

Lu: It shows that using observed and mined latent hallucinations to build a dataset like RealmSet significantly improves performance across multiple visual perception and hallucination benchmarks <ref:2611.06433#pg3>.

Meng: From a deployment standpoint, the cost is data construction, including image generation with GPT-Image and human review, which is a hurdle for scaling this up <ref:2611.06433#pg3>.

Lalam: They also note that DreamRealm is constrained by the capabilities of the underlying image-editing model; they mentioned an overall editing pass rate of thirty point zero seven percent across all categories <ref:2611.06433#pg3>.

Tom: So, while the results on Qwen3 point 5-9B are strong, we have to account for the effort in creating those edited examples and how well the editing model performs <ref:2611.06433#pg3>.

Jane: It’s a solid paradigm to explore because it shifts the focus from simple error correction to understanding the visual context that causes confusion <ref:2611.06433#pg2>.

Lu: The work on DreamRealm is interesting because it provides a concrete way to design supervision around specific perceptual confusions, which is something that was previously underexplored <ref:2611.06433#pg2>.

Meng: It's an interesting direction for research, but the bottleneck remains the data pipeline itself and ensuring the editing quality holds up under high load <ref:2611.06433#pg3>.

Lalam: Ultimately, DreamRealm shows that assignment of hallucination is a viable strategy for improving visual perception and mitigating hallucinations in these multimodal models <ref:2611.06433#pg3>.

Alibaba Group

cs.CV

Submitted: 2026-11-04

Updated: 2026-11-05

Comments: 28 pages, including supplementary material. Code: https://github.com/Alibaba-VELLDEPTH/DreamRealm . Model: https://huggingface.co/Alibaba-VELLDEPTH/Qwen35-9b-DreamRealm

License: http://creativecommons.org/licenses/by/4.0/

Importance score: 100/100

The gist: Multimodal large language models (MLLMs) remain prone to visual hallucinations when correct responses depend on subtle visual details.

Key concepts

RealmForgePipe
This is a data pipeline designed to explore and materialize the model's own hallucinations. It uses techniques like high-temperature sampling and key-attribute enumeration to find latent perceptual confusions within the target model, setting up the foundation for creating training data.
RealmMatch
This module learns how images correspond to responses by constructing a likelihood score matrix. It uses supervised learning and contrastive losses—both image-conditioned and response-conditioned—to reinforce correct pairings and suppress incorrect associations during training.
Hallucination Exploration
The initial stage of the pipeline involves actively mining latent hallucinations from the target model. This is done by sampling responses at high temperatures and enumerating key visual attributes, allowing the framework to discover novel, subtle visual confusions that existing datasets might miss.
Bidirectional Contrastive Losses
These are specific loss functions used in RealmMatch training. The row-wise loss ensures a response is matched to its correct edited image, while the column-wise loss ensures an image is correctly associated with its supporting response, creating a strong, mutually reinforcing learning signal.

Terminology

Summary

Multimodal large language models (MLLMs) remain prone to visual hallucinations when correct responses depend on subtle visual details. p. 0

Where the paper says it

†Corresponding authors. Abstract Multimodal large language models (MLLMs) remain prone to visual hallucinations when correct responses depend on subtle visual details.

DreamRealm is a post-training framework that explores diverse latent hallucinated responses, minimally edits original images to make them valid, and trains the model to assign each response to its supporting image. p. 0
Where the paper says it

Another line suppresses hallucinated outputs through response correction or preference learning under fixed image conditions, but leaves the design of supervision signals on the image-input side underexplored. Inspired by how humans correct misconceptions, we introduce DreamRealm, a post-training framework that explores diverse latent hallucinated responses, minimally edits original images to make them valid, and trains the model to assign each response to its supporting image.

Pruning redundant reasoning tokens

The authors introduce DreamRealm as a post-training framework centered on matching hallucinated responses to their supporting images. This framework consists of RealmForgePipe, a data pipeline for exploring and materializing a model’s own hallucinations, and RealmMatch, which learns image–response correspondence. p. 3

Where the paper says it

3 Method DreamRealm consists of RealmForgePipe, a data pipeline for exploring and materializing a model’s own hallucinations, and RealmMatch, which learns image–response correspondence. Figure 2 illustrates the overall framework.

The pipeline first involves hallucination exploration to identify latent perceptual hallucinations through high-temperature sampling and key-attribute enumeration. p. 4
Where the paper says it

We call these responses latent perceptual hallucinations. Incorrect responses produced under standard decoding are termed observed hallucinations; latent mining explores additional errors through high-temperature sampling and key-attribute enumeration.

Subsequently, the materialization stage uses minimal image editing and verification to construct visual conditions that make the selected responses valid. p. 3
Where the paper says it

1 introduces hallucination exploration, which collects observed hallucinations, mines latent hallucinations, and selects candidate responses through likelihood ranking; Section 3. 2 introduces hallucination materialization, which uses minimal image editing and verification to construct visual conditions that make the selected hallucinated responses valid.

How the training signal is built

The RealmMatch module constructs a likelihood score matrix across image–response combinations and combines supervised learning with bidirectional contrastive losses to reinforce correct matches and suppress mismatches. Specifically, it employs an image-conditioned response contrast loss (row-wise) which favors the matching response over other responses within each family, including hallucinated responses under their corresponding edited images. p. 5

Where the paper says it

Bidirectional correspondence learning. We first introduce an image-conditioned response contrast loss (row-wise), which favors the matching response over other responses within each family, including hallucinated responses under their corresponding edited images: L edit row = − 1 n X K i=0 log exp(Sii/τ ) PK j=0 exp(Sij/τ ) .

Concurrently, the response-conditioned image contrast loss (column-wise) holds each response fixed and favors its supporting image over other images within the same family, encouraging each hallucinated response to be assigned to the edited image that makes it valid. p. 5
Where the paper says it

We first introduce an image-conditioned response contrast loss (row-wise), which favors the matching response over other responses within each family, including hallucinated responses under their corresponding edited images: L edit row = − 1 n X K i=0 log exp(Sii/τ ) PK j=0 exp(Sij/τ ) . (3) Correspondingly, the response-conditioned image contrast loss (column-wise) holds each response fixed and favors its supporting image over other images within the same family, encouraging each hallucinated response to be assigned to the edited image that makes it valid: L edit col = − 1 n X K j=0 log exp(Sjj/τ ) PK i=0 exp(Sij/τ ) .

The joint training objective is defined as Ledit = λrLeditrow + λcLeditcol + LeditSFT. p. 6
Where the paper says it

We additionally apply SFT to matched image–response pairs to increase their likelihood: L edit SFT = − 1 n X K i=0 Sii. (5) The joint training objective is Ledit = λrL edit row + λcL edit col + L edit SFT, (6) where λr, λc ≥ 0.

Where the gains come from

The framework demonstrates improvements across six visual perception and hallucination benchmarks on Qwen3.5-9B, including gains of 7. p. 0

Where the paper says it

Compared with the original Qwen3. 5-9B model, DreamRealm improves performance across six visual perception and hallucination benchmarks, including gains of 7.

26 percentage points in HallusionBench accuracy and 11. p. 0
Where the paper says it

5-9B model, DreamRealm improves performance across six visual perception and hallucination benchmarks, including gains of 7. 26 percentage points in HallusionBench accuracy and 11.

34 percentage points in MMVP pair accuracy. p. 0
Where the paper says it

26 percentage points in HallusionBench accuracy and 11. 34 percentage points in MMVP pair accuracy.

The RealmForgePipe data construction pipeline, RealmSet, derived from hallucinations mined from Qwen3. p. 0
Where the paper says it

Our data construction pipeline, RealmForgePipe, mines observed and latent hallucinations from a target model and materializes them through image editing. Using hallucinations mined from Qwen3.

5-9B, allows the training data to align with the model’s perceptual confusions. p. 6
Where the paper says it

The gains are largest on Qwen3. 5-9B, reflecting DreamRealm’s model-specific design: RealmForgePipe constructs supervision from the model’s high-likelihood hallucinations, aligning the training data with its perceptual confusions.

Ablation studies show that targeting observed errors improves five of seven metrics over unguided editing, while adding latent hallucinations improves all seven metrics over Observed Only. p. 8
Where the paper says it

Original-only supervision degrades HallusionBench, and unguided edits remain below Raw on HallusionBench and CV-Bench-2D. Targeting observed errors improves five of seven metrics over unguided editing, while adding latent hallucinations improves all seven metrics over Observed Only.

Empirical validation and ablation analysis

The experiments compare DreamRealm with specialized hallucination-mitigation methods, such as VCD [13], CoCI-CAP [17], and RLAIF-V [42]. When training on its own hallucinations, DreamRealm improves all seven metrics over the corresponding base model, with gains being largest on Qwen3. p. 6

Where the paper says it

5-9B, DreamRealm improves all seven metrics, mitigating hallucinations while enhancing fine-grained perception. The gains are largest on Qwen3.

5-9B. The final results show that hallucination assignment is a promising paradigm for improving visual perception and mitigating hallucinations. p. 0
Where the paper says it

34 percentage points in MMVP pair accuracy. Together with ablation studies on data construction and training methods, these results demonstrate that hallucination assignment is a promising paradigm for improving visual perception and mitigating hallucinations.

Limitations

DreamRealm incurs data construction costs, including image generation with GPT-Image and human review, as detailed in Appendices D and D.2. Furthermore, DreamRealm is constrained by the capabilities of the underlying image-editing model. p. 8

Where the paper says it

2, respectively. In addition, DreamRealm is constrained by the capabilities of the underlying image-editing model, and some scenes remain difficult to edit successfully.

The data construction pipeline has an overall editing pass rate of 30. p. 0
Where the paper says it

Inspired by how humans correct misconceptions, we introduce DreamRealm, a post-training framework that explores diverse latent hallucinated responses, minimally edits original images to make them valid, and trains the model to assign each response to its supporting image. Our data construction pipeline, RealmForgePipe, mines observed and latent hallucinations from a target model and materializes them through image editing.

07% across all categories. p. 8
Where the paper says it

Appendix D. 1 (Table 4) reports the final pass rates of RealmForgePipe across 22 question categories, measured as the proportion of synthesis candidates ultimately approved by human review.

The final retained data contains 28,960 unique edited examples. p. 5
Where the paper says it

Each question-centered family contains the original image–answer pair and human-approved edited image–response pairs, with the question held fixed. RealmSet spans 22 perceptual question categories and contains 28,960 human-approved edited examples.

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Materialize model hallucination worlds by using RealmForgePipe to mine latent hallucinations from a target model like Qwen3.5-9B and minimally edit original images to make them valid, ensuring supervision targets actual perceptual confusions rather than just fixing erroneous responses under fixed image conditions.

  2. Train the model using RealmMatch, which constructs a likelihood score matrix across image response combinations and uses bidirectional contrastive losses to suppress mismatched responses while assigning each hallucinated response to its corresponding supporting image.

  3. Improve visual perception and mitigate hallucinations by training on original examples alongside the 27,038 HG-Edited training examples in RealmSet, resulting in gains of 7.26 percentage points in HallusionBench accuracy and 11.34 percentage points in MMVP pair accuracy on Qwen3.5-9B.

  4. Develop a data construction pipeline that mines observed and latent hallucinations from a target model to build the Realized Hallucination Dataset (RealmSet), which contains 28,960 human-approved edited examples spanning 22 perceptual question categories.

  5. Systematically analyze the roles of hallucination-guided image editing, latent hallucination mining, and bidirectional correspondence learning through ablation studies to determine the most effective components for improving visual perception and mitigating hallucinations.

Abstract

Multimodal large language models (MLLMs) remain prone to visual hallucinations when correct responses depend on subtle visual details. One line of post-training methods constructs visual contrasts through image retrieval, generation, or editing to improve fine-grained perception. However, these contrasts are not built around the model's own hallucinations, making it difficult to ensure that supervision targets its actual perceptual confusions. Another line suppresses hallucinated outputs through response correction or preference learning under fixed image conditions, but leaves the design of supervision signals on the image-input side underexplored. Inspired by how humans correct misconceptions, we introduce DreamRealm, a post-training framework that explores diverse latent hallucinated responses, minimally edits original images to make them valid, and trains the model to assign each response to its supporting image. Our data construction pipeline, RealmForgePipe, mines observed and latent hallucinations from a target model and materializes them through image editing. Using hallucinations mined from Qwen3.5-9B, we construct the Realized Hallucination Dataset (RealmSet). Our training objective, RealmMatch, constructs a likelihood score matrix across image--response combinations and combines supervised learning with bidirectional contrastive losses to reinforce correct matches and suppress mismatches. Compared with the original Qwen3.5-9B model, DreamRealm improves performance across six visual perception and hallucination benchmarks, including gains of 7.26 percentage points in HallusionBench accuracy and 11.34 percentage points in MMVP pair accuracy. Together with ablation studies on data construction and training methods, these results demonstrate that hallucination assignment is a promising paradigm for improving visual perception and mitigating hallucinations.

Sources

Related papers