Do Generative Priors Align with Human Naturalness Perception?
cs.CV, q-bio.NC
Submitted: 2026-10-07
Updated: 2026-10-07
Comments: 62 pages, 35 figures, including appendices
Code: https://github.com/t-fukiage/generative-p
License: http://creativecommons.org/licenses/by/4.0/
The gist: Visual generative models are trained to capture the probability distributions of natural images, yet whether their native priors reflect the regularities governing human perception of image
Abstract
Visual generative models are trained to capture the probability distributions of natural images, yet whether their native priors reflect the regularities governing human perception of image naturalness remains an open question. Here, we probe these priors through native prediction errors across 25 open image and video generators. Because raw single-image losses are dominated by scene content and visual complexity, we evaluate directional loss differences using content-preserving, paired relational interventions that selectively disrupt facial configurations or physical illumination consistency while limiting changes in low-level image statistics. Across both domains, these loss differences reproduce human-like selective sensitivities and tolerances, capturing the classic Thatcher effect on faces and shape-dependent responses to illumination inconsistencies. Notably, these loss differences reliably track continuous gradations of human naturalness judgments across individual stimulus pairs (peaking at r =.84 on faces and.64 on physical scenes) and retain unique human-aligned signals even after controlling for feature distances from frozen vision encoders and standard image quality metrics. We also find that while overall sensitivity to these violations broadly covaries with human alignment across models, the two systematically decouple along denoising schedules, with alignment peaking earlier than sensitivity, revealing that human-like naturalness judgments dissociate from generic violation detection. Together, these findings demonstrate that learning visual distributions yields generative loss landscapes that capture distinct aspects of human naturalness perception.
Sources
- HiDream-O1-Image: A Natively Unified Image Generative Foundation Model with Pixel-level Unified Transformer
- Lighting (In)consistency of Paint by Text
- DP-IQA: Utilizing Diffusion Prior for Blind Image Quality Assessment in the Wild
- LTX-Video: Realtime Video Latent Diffusion
- HunyuanVideo: A Systematic Framework For Large Video Generative Models
- jina-clip-v2: Multilingual Multimodal Embeddings for Text and Images
- Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Ranking
- PixelGen: Improving Pixel Diffusion with Perceptual Supervision
- Assessing Image Quality Using a Simple Generative Representation
- Wan: Open and Advanced Large-Scale Video Generative Models
- SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features
- Qwen-Image Technical Report
- YoCausal: How Far is Video Generation from World Model? A Causality Perspective
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models