PreviewDiff: Multimodal Critic-Guided Search over Diffusion Latents
cs.CV, cs.AI, cs.LG
Submitted: 2026-09-28
Updated: 2026-09-28
Comments: 24 pages, 11 figures, 3 tables
Project page: https://previewdiff.github.io
License: http://creativecommons.org/licenses/by/4.0/
The gist: Diffusion models can produce striking images and videos, but they still struggle with the compositional details that make a generation faithful to a prompt, such as object counts, attribute binding,
Terminology
Abstract
Diffusion models can produce striking images and videos, but they still struggle with the compositional details that make a generation faithful to a prompt, such as object counts, attribute binding, spatial relations, and temporally grounded actions. A common way to improve prompt satisfaction is to spend more compute at test time through Best-of-N sampling, but final-sample selection is fixed. Best-of-N can only choose among completed outputs and cannot repair a promising trajectory before it fails. We introduce PreviewDiff, a training-free test-time search method that turns diffusion sampling from scalar search into a multimodal critic-guided search over intermediate latents. At selected denoising checkpoints, PreviewDiff decodes a partial preview, asks a multimodal judge to score and critique it, and uses the resulting natural-language feedback to branch over semantic prompt edits and locally re-noised latent continuations. These branches are then scored and selectively rolled forward, allowing verifier compute to guide generation while the sample is still editable. Across image and video generation benchmarks, PreviewDiff consistently improves over budget-matched Best-of-N selection and strong scalar-search baselines. Ablations show that earlier interventions and increased search width provide the largest gains, while deeper search and additional semantic variants offer complementary improvements. PreviewDiff demonstrates that multimodal feedback is most useful not only as a final verifier, but as an active controller inside the denoising process.
Sources
- Qwen3-VL Technical Report
- NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generation
- LTX-Video: Realtime Video Latent Diffusion
- Anchored Video Generation: Decoupling Scene Construction and Temporal Synthesis in Text-to-Video Diffusion Models
- Scaling Image and Video Generation via Test-Time Evolutionary Search
- Classifier-Free Diffusion Guidance
- Diffusion Tree Sampling: Scalable inference-time alignment of diffusion models
- GenEval 2: Addressing Benchmark Drift in Text-to-Image Evaluation
- Test-time Alignment of Diffusion Models without Reward Over-optimization
- Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?
- Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps
- Hierarchical Text-Conditional Image Generation with CLIP Latents
- Test-Time Scaling of Diffusion Models via Noise Trajectory Search
- A General Framework for Inference-time Scaling and Steering of Diffusion Models
- Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
- UniGen: Enhanced Training & Test-Time Strategies for Unified Multimodal Understanding and Generation
- Wan: Open and Advanced Large-Scale Video Generative Models
- Monte Carlo Tree Diffusion for System 2 Planning
- VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models