Stochastic Generative Plug-and-Play Priors
cs.CV, cs.LG, eess.IV
Submitted: 2026-04-04
Updated: 2026-10-30
Code: https://github.com/uw-cig/SGPnP
License: http://creativecommons.org/licenses/by/4.0/
The gist: Plug-and-play (PnP) methods are widely used for solving imaging inverse problems by incorporating a denoiser into an optimization algorithm.
Terminology
Abstract
Plug-and-play (PnP) methods are widely used for solving imaging inverse problems by incorporating a denoiser into an optimization algorithm. Score-based diffusion models (SBDMs) have recently demonstrated strong generative performance via a denoiser trained across a wide range of noise levels. Despite their shared reliance on denoisers, it remains unclear how to systematically use SBDMs as priors within the PnP framework without relying on reverse diffusion sampling. In this paper, we establish a score-based interpretation of PnP that justifies using pretrained SBDMs directly within PnP algorithms. Building on this connection, we introduce a stochastic generative PnP (SGPnP) framework that uses stochastic re-noising to better leverage the broad noise-level conditioning of pretrained SBDMs, significantly improving reconstruction quality in severely ill-posed inverse problems. We show that noise injection induces optimization on a Gaussian-smoothed objective and enables avoidance of strict saddle points under suitable conditions. Experiments on challenging inverse tasks, such as multi-coil MRI reconstruction and large-mask natural image inpainting, demonstrate consistent improvement over conventional PnP methods and achieve performance competitive with diffusion-based solvers.
Sources
- Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstruction
- Regularization by denoising: Bayesian model and Langevin-within-split Gibbs sampling
- PnP-CM: Consistency Models as Plug-and-Play Priors for Inverse Problems
- A Survey on Diffusion Models for Inverse Problems
- A Fast Stochastic Plug-and-Play ADMM for Imaging Inverse Problems
- Async-RED: A Provably Convergent Asynchronous Block Parallel Stochastic Method using Deep Denoising Priors
- Plug-In Stochastic Gradient Method
- fastMRI: An Open Dataset and Benchmarks for Accelerated MRI
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs