Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problems

11/20/2022
by   Xiangming Meng, et al.
0

We consider the ubiquitous linear inverse problems with additive Gaussian noise and propose an unsupervised general-purpose sampling approach called diffusion model based posterior sampling (DMPS) to reconstruct the unknown signal from noisy linear measurements. Specifically, the prior of the unknown signal is implicitly modeled by one pre-trained diffusion model (DM). In posterior sampling, to address the intractability of exact noise-perturbed likelihood score, a simple yet effective noise-perturbed pseudo-likelihood score is introduced under the uninformative prior assumption. While DMPS applies to any kind of DM with proper modifications, we focus on the ablated diffusion model (ADM) as one specific example and evaluate its efficacy on a variety of linear inverse problems such as image super-resolution, denoising, deblurring, colorization. Experimental results demonstrate that, for both in-distribution and out-of-distribution samples, DMPS achieves highly competitive or even better performances on various tasks while being 3 times faster than the leading competitor. The code to reproduce the results is available at https://github.com/mengxiangming/dmps.

READ FULL TEXT

page 7

page 8

page 15

page 16

page 17

page 18

page 19

page 20

research
01/30/2023

GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restoration

Pre-trained diffusion models have been successfully used as priors in a ...
research
05/31/2021

SNIPS: Solving Noisy Inverse Problems Stochastically

In this work we introduce a novel stochastic algorithm dubbed SNIPS, whi...
research
06/12/2023

Generative Plug and Play: Posterior Sampling for Inverse Problems

Over the past decade, Plug-and-Play (PnP) has become a popular method fo...
research
11/02/2022

Quantized Compressed Sensing with Score-Based Generative Models

We consider the general problem of recovering a high-dimensional signal ...
research
07/27/2020

Solving Linear Inverse Problems Using the Prior Implicit in a Denoiser

Prior probability models are a central component of many image processin...
research
05/02/2023

Solving Inverse Problems with Score-Based Generative Priors learned from Noisy Data

We present SURE-Score: an approach for learning score-based generative m...
research
12/02/2022

Accelerating Inverse Learning via Intelligent Localization with Exploratory Sampling

In the scope of "AI for Science", solving inverse problems is a longstan...

Please sign up or login with your details

Forgot password? Click here to reset