Regularization by Denoising: Clarifications and New Interpretations

06/06/2018
by   Edward T. Reehorst, et al.
0

Regularization by Denoising (RED), as recently proposed by Romano, Elad, and Milanfar, is powerful new image-recovery framework that aims to construct an explicit regularization objective from a plug-in image-denoising function. Evidence suggests that the RED algorithms are, indeed, state-of-the-art. However, a closer inspection suggests that explicit regularization may not explain the workings of these algorithms. In this paper, we clarify that the expressions in Romano et al. hold only when the denoiser has a symmetric Jacobian, and we demonstrate that such symmetry does not occur with practical denoisers such as non-local means, BM3D, TNRD, and DnCNN. Going further, we prove that non-symmetric denoising functions cannot be modeled by any explicit regularizer. In light of these results, there remains the question of how to justify the good-performing RED algorithms for practical denoisers. In response, we propose a new framework called "score-matching by denoising" (SMD), which aims to match the score (i.e., the gradient of the log-prior) instead of designing the regularizer itself. We also show tight connections between SMD, kernel density estimation, and constrained minimum mean-squared error denoising. Finally, we provide new interpretations of the RED algorithms proposed by Romano et al., and we propose novel RED algorithms with faster convergence.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/29/2022

Learned Gradient of a Regularizer for Plug-and-Play Gradient Descent

The Plug-and-Play (PnP) framework allows integrating advanced image deno...
research
01/27/2021

An Interpretation of Regularization by Denoising and its Application with the Back-Projected Fidelity Term

The vast majority of image recovery tasks are ill-posed problems. As suc...
research
08/01/2020

Regularization by Denoising via Fixed-Point Projection (RED-PRO)

Inverse problems in image processing are typically cast as optimization ...
research
09/04/2019

Online Regularization by Denoising with Applications to Phase Retrieval

Regularization by denoising (RED) is a powerful framework for solving im...
research
04/07/2023

RED-PSM: Regularization by Denoising of Partially Separable Models for Dynamic Imaging

Dynamic imaging addresses the recovery of a time-varying 2D or 3D object...
research
07/01/2023

AE-RED: A Hyperspectral Unmixing Framework Powered by Deep Autoencoder and Regularization by Denoising

Spectral unmixing has been extensively studied with a variety of methods...

Please sign up or login with your details

Forgot password? Click here to reset