A regularized deep matrix factorized model of matrix completion for image restoration

07/29/2020
by   Zhemin Li, et al.
0

It has been an important approach of using matrix completion to perform image restoration. Most previous works on matrix completion focus on the low-rank property by imposing explicit constraints on the recovered matrix, such as the constraint of the nuclear norm or limiting the dimension of the matrix factorization component. Recently, theoretical works suggest that deep linear neural network has an implicit bias towards low rank on matrix completion. However, low rank is not adequate to reflect the intrinsic characteristics of a natural image. Thus, algorithms with only the constraint of low rank are insufficient to perform image restoration well. In this work, we propose a Regularized Deep Matrix Factorized (RDMF) model for image restoration, which utilizes the implicit bias of the low rank of deep neural networks and the explicit bias of total variation. We demonstrate the effectiveness of our RDMF model with extensive experiments, in which our method surpasses the state of art models in common examples, especially for the restoration from very few observations. Our work sheds light on a more general framework for solving other inverse problems by combining the implicit bias of deep learning with explicit regularization.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 7

page 8

page 9

page 10

research
04/26/2015

Analysis of Nuclear Norm Regularization for Full-rank Matrix Completion

In this paper, we provide a theoretical analysis of the nuclear-norm reg...
research
06/01/2023

Combining Explicit and Implicit Regularization for Efficient Learning in Deep Networks

Works on implicit regularization have studied gradient trajectories duri...
research
10/12/2021

AIR-Net: Adaptive and Implicit Regularization Neural Network for Matrix Completion

Conventionally, the matrix completion (MC) model aims to recover a matri...
research
08/11/2022

Adaptive and Implicit Regularization for Matrix Completion

The explicit low-rank regularization, e.g., nuclear norm regularization,...
research
07/05/2019

Depth Restoration: A fast low-rank matrix completion via dual-graph regularization

As a real scenes sensing approach, depth information obtains the widespr...
research
10/22/2022

Deep Linear Networks for Matrix Completion – An Infinite Depth Limit

The deep linear network (DLN) is a model for implicit regularization in ...
research
02/16/2018

Learning Latent Features with Pairwise Penalties in Matrix Completion

Low-rank matrix completion (MC) has achieved great success in many real-...

Please sign up or login with your details

Forgot password? Click here to reset