Implicit Regularization Effects of the Sobolev Norms in Image Processing

09/13/2021
by   Yunan Yang, et al.
0

In this paper, we propose to use the general L^2-based Sobolev norms (i.e., H^s norms, s∈ℝ) to measure the data discrepancy due to noise in image processing tasks that are formulated as optimization problems. As opposed to a popular trend of developing regularization methods, we emphasize that an implicit regularization effect can be achieved through the class of Sobolev norms as the data-fitting term. Specifically, we analyze that the implicit regularization comes from the weights that the H^s norm imposes on different frequency contents of an underlying image. We also build the connections of such norms with the optimal transport-based metrics and the Sobolev gradient-based methods, leading to a better understanding of functional spaces/metrics and the optimization process involved in image processing. We use the fast Fourier transform to compute the H^s norm efficiently and combine it with the total variation regularization in the framework of the alternating direction method of multipliers (ADMM). Numerical results in both denoising and deblurring support our theoretical findings.

READ FULL TEXT

page 6

page 14

page 15

page 17

page 18

research
07/01/2014

Imaging with Kantorovich-Rubinstein discrepancy

We propose the use of the Kantorovich-Rubinstein norm from optimal trans...
research
05/13/2020

Implicit Regularization in Deep Learning May Not Be Explainable by Norms

Mathematically characterizing the implicit regularization induced by gra...
research
02/27/2018

L0TV: A Sparse Optimization Method for Impulse Noise Image Restoration

Total Variation (TV) is an effective and popular prior model in the fiel...
research
12/24/2013

New explicit thresholding/shrinkage formulas for one class of regularization problems with overlapping group sparsity and their applications

The least-square regression problems or inverse problems have been widel...
research
10/28/2019

Tractability properties of the discrepancy in Orlicz norms

We show that the minimal discrepancy of a point set in the d-dimensional...
research
12/13/2014

First order algorithms in variational image processing

Variational methods in imaging are nowadays developing towards a quite u...
research
02/07/2020

Optimization of Structural Similarity in Mathematical Imaging

It is now generally accepted that Euclidean-based metrics may not always...

Please sign up or login with your details

Forgot password? Click here to reset