Nonparametric Deconvolution and Denoising using Simulation Based Inference
Ritwik Vashistha, Abhra Sarkar, Arya Farahi
stat.ME, stat.ML
Submitted: 2026-06-20
License: http://creativecommons.org/licenses/by/4.0/
The gist: Latent signals are often obscured by measurement noise, yet encode the underlying laws and dynamics of complex systems; learning both the signals and their distributions remains a central challenge
Terminology
Abstract
Latent signals are often obscured by measurement noise, yet encode the underlying laws and dynamics of complex systems; learning both the signals and their distributions remains a central challenge in scientific inference. The noise is often non-negligible, and the likelihoods for expressive generative models are often intractable. We utilize a convolutional maximum mean discrepancy (convMMD) loss and propose a likelihood-free framework for nonparametric density deconvolution and empirical Bayes denoising under additive measurement error. Our method learns a latent generative model by matching the observed data distribution to the noise-convolved model distribution. This yields a differentiable, simulation-based objective for multivariate homoscedastic or heteroscedastic noise, compatible with expressive sieve classes such as Gaussian mixtures and normalizing flows. The learned density then serves as an empirical prior for posterior denoising of individual latent values. Theoretically, we extend convMMD from parametric to nonparametric estimation, proving finite-sample bounds for empirical sieve minimizers and L 2 convergence rates under Sobolev smoothness. These rates recover the classical inverse-problem dependence: polynomial for ordinary-smooth and logarithmic for super-smooth noises. Our method provides a practical, theoretically grounded approach to deconvolution and denoising under generative latent distribution models.
Sources
- The DECADE cosmic shear project I: A new weak lensing shape catalog of 107 million galaxies
- Density Deconvolution with Normalizing Flows
- Convolutional Maximum Mean Discrepancy for Inference in Noisy Data
- Spectral Normalization for Generative Adversarial Networks
- A Practical Introduction to Kernel Discrepancies: MMD, HSIC & KSD
Related papers
- Doubly robust inference via calibration
- Bayesian Empirical Bayes: Simultaneous Inference from Probabilistic Symmetries
- Weak-Form Recovery of Stochastic Generators
- Optimal Watermark Localization in Mixed-Source Large Language Model Texts
- Optimized Conformal Selection: Powerful Selective Inference After Data-Dependent Score Construction
- Small area learning