Plug-and-Play Image Restoration with Deep Denoiser Prior

08/31/2020
by   Kai Zhang, et al.
1

Recent works on plug-and-play image restoration have shown that a denoiser can implicitly serve as the image prior for model-based methods to solve many inverse problems. Such a property induces considerable advantages for plug-and-play image restoration (e.g., integrating the flexibility of model-based method and effectiveness of learning-based methods) when the denoiser is discriminatively learned via deep convolutional neural network (CNN) with large modeling capacity. However, while deeper and larger CNN models are rapidly gaining popularity, existing plug-and-play image restoration hinders its performance due to the lack of suitable denoiser prior. In order to push the limits of plug-and-play image restoration, we set up a benchmark deep denoiser prior by training a highly flexible and effective CNN denoiser. We then plug the deep denoiser prior as a modular part into a half quadratic splitting based iterative algorithm to solve various image restoration problems. We, meanwhile, provide a thorough analysis of parameter setting, intermediate results and empirical convergence to better understand the working mechanism. Experimental results on three representative image restoration tasks, including deblurring, super-resolution and demosaicing, demonstrate that the proposed plug-and-play image restoration with deep denoiser prior not only significantly outperforms other state-of-the-art model-based methods but also achieves competitive or even superior performance against state-of-the-art learning-based methods. The source code is available at https://github.com/cszn/DPIR.

READ FULL TEXT

page 3

page 5

page 8

page 9

page 10

page 11

page 12

research
11/14/2022

CurvPnP: Plug-and-play Blind Image Restoration with Deep Curvature Denoiser

Due to the development of deep learning-based denoisers, the plug-and-pl...
research
05/15/2023

Denoising Diffusion Models for Plug-and-Play Image Restoration

Plug-and-play Image Restoration (IR) has been widely recognized as a fle...
research
09/17/2022

Deep Plug-and-Play Prior for Hyperspectral Image Restoration

Deep-learning-based hyperspectral image (HSI) restoration methods have g...
research
11/29/2017

Deep Image Prior

Deep convolutional networks have become a popular tool for image generat...
research
07/25/2022

REPNP: Plug-and-Play with Deep Reinforcement Learning Prior for Robust Image Restoration

Image restoration schemes based on the pre-trained deep models have rece...
research
04/11/2017

Learning Deep CNN Denoiser Prior for Image Restoration

Model-based optimization methods and discriminative learning methods hav...
research
02/15/2021

Plug-and-Play external and internal priors for image restoration

Image restoration problems were traditionally formulated as the minimiza...

Please sign up or login with your details

Forgot password? Click here to reset