Deblurring via Stochastic Refinement

12/05/2021
by   Jay Whang, et al.
0

Image deblurring is an ill-posed problem with multiple plausible solutions for a given input image. However, most existing methods produce a deterministic estimate of the clean image and are trained to minimize pixel-level distortion. These metrics are known to be poorly correlated with human perception, and often lead to unrealistic reconstructions. We present an alternative framework for blind deblurring based on conditional diffusion models. Unlike existing techniques, we train a stochastic sampler that refines the output of a deterministic predictor and is capable of producing a diverse set of plausible reconstructions for a given input. This leads to a significant improvement in perceptual quality over existing state-of-the-art methods across multiple standard benchmarks. Our predict-and-refine approach also enables much more efficient sampling compared to typical diffusion models. Combined with a carefully tuned network architecture and inference procedure, our method is competitive in terms of distortion metrics such as PSNR. These results show clear benefits of our diffusion-based method for deblurring and challenge the widely used strategy of producing a single, deterministic reconstruction.

READ FULL TEXT

page 18

page 20

page 21

page 22

page 23

page 24

page 25

page 26

research
03/25/2023

DiracDiffusion: Denoising and Incremental Reconstruction with Assured Data-Consistency

Diffusion models have established new state of the art in a multitude of...
research
11/21/2022

High-Perceptual Quality JPEG Decoding via Posterior Sampling

JPEG is arguably the most popular image coding format, achieving high co...
research
12/04/2022

Image Deblurring with Domain Generalizable Diffusion Models

Diffusion Probabilistic Models (DPMs) have recently been employed for im...
research
03/20/2023

Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restoration

Inversion by Direct Iteration (InDI) is a new formulation for supervised...
research
08/21/2023

Frequency Compensated Diffusion Model for Real-scene Dehazing

Due to distribution shift, deep learning based methods for image dehazin...
research
09/04/2023

ControlMat: A Controlled Generative Approach to Material Capture

Material reconstruction from a photograph is a key component of 3D conte...
research
10/04/2022

HandFlow: Quantifying View-Dependent 3D Ambiguity in Two-Hand Reconstruction with Normalizing Flow

Reconstructing two-hand interactions from a single image is a challengin...

Please sign up or login with your details

Forgot password? Click here to reset