Traversing the Satisfaction-Diversity Frontier in Text-to-Image Diffusion
cs.AI
Submitted: 2026-10-01
Updated: 2026-10-01
Comments: 40 pages, including appendices. Code: https://github.com/UCF-CRCV/SatisDive
Code: https://github.com/UCF-CRCV/SatisDive
License: http://creativecommons.org/licenses/by/4.0/
The gist: Text-to-image generation enables users to explore several images generated from the same prompt.
Abstract
Text-to-image generation enables users to explore several images generated from the same prompt. For these generated images to be useful, each one must reflect the user's preferences, measured by a learned reward, and differ visually from the others to maintain diversity. Existing methods are limited: they either address reward and diversity separately or combine them in one aggregate score, enabling high diversity to offset low rewards. In this paper, we address these limitations by formulating generation as satisficing: every image (candidate) must satisfy a reward floor and the batch of images must satisfy a diversity cutoff. The reward floor controls the balance between worst-candidate reward and batch diversity; we show that varying this floor defines a Pareto frontier. To traverse this frontier, we introduce SatisDive, a training-free inference-time method. SatisDive uses a batch-relative reward cutoff to distinguish lower- from higher-reward candidates, emphasizing reward improvement for candidates below the cutoff and diversity among candidates above it. On Pick-a-Pic, at matched DreamSim, SatisDive improves worst-candidate reward over FK steering by up to 0.43 with FLUX.1-dev as the base model and HPSv3 as the reward, and by up to 0.70 with SANA-1.6B as the base model and ImageReward as the reward. More broadly, across their overlapping DreamSim ranges, SatisDive's satisfaction-diversity curve Pareto-dominates FK steering's curve in each setting.
Sources
- Particle Guidance: non-I.I.D. Diverse Sampling with Diffusion Models
- ParetoSlider: Diffusion Models Post-Training for Continuous Reward Control
- It's Never Too Late: Noise Optimization for Collapse Recovery in Trained Diffusion Models
- Denoising Diffusion Probabilistic Models
- Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation
- Initialization is Half the Battle: Generating Diverse Images from a Guidance Potential Posterior
- Feynman-Kac-Flow: Inference Steering of Conditional Flow Matching to an Energy-Tilted Posterior
- VASR: Variance-Aware Systematic Resampling for Reward-Guided Diffusion
- Negative Token Merging: Image-based Adversarial Feature Guidance
- Diverse Sampling in Diffusion Models with Divergence-Free Particle Guidance
- Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis
- STRIDE: Training-Free Diversity Guidance via PCA-Directed Feature Perturbation in Single-Step Diffusion Models
- MIRA: Towards Mitigating Reward Hacking in Inference-Time Alignment of T2I Diffusion Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems