The Spectral Bias of the Deep Image Prior

12/18/2019
by   Prithvijit Chakrabarty, et al.
21

The "deep image prior" proposed by Ulyanov et al. is an intriguing property of neural nets: a convolutional encoder-decoder network can be used as a prior for natural images. The network architecture implicitly introduces a bias; If we train the model to map white noise to a corrupted image, this bias guides the model to fit the true image before fitting the corrupted regions. This paper explores why the deep image prior helps in denoising natural images. We present a novel method to analyze trajectories generated by the deep image prior optimization and demonstrate: (i) convolution layers of the an encoder-decoder decouple the frequency components of the image, learning each at different rates (ii) the model fits lower frequencies first, making early stopping behave as a low pass filter. The experiments study an extension of Cheng et al which showed that at initialization, the deep image prior is equivalent to a stationary Gaussian process.

READ FULL TEXT

page 2

page 6

page 7

research
01/16/2018

Image denoising and restoration with CNN-LSTM Encoder Decoder with Direct Attention

Image denoising is always a challenging task in the field of computer vi...
research
04/16/2019

A Bayesian Perspective on the Deep Image Prior

The deep image prior was recently introduced as a prior for natural imag...
research
12/19/2013

Approximated Infomax Early Stopping: Revisiting Gaussian RBMs on Natural Images

We pursue an early stopping technique that helps Gaussian Restricted Bol...
research
07/02/2021

On Measuring and Controlling the Spectral Bias of the Deep Image Prior

The deep image prior has demonstrated the remarkable ability that untrai...
research
10/31/2019

Denoising and Regularization via Exploiting the Structural Bias of Convolutional Generators

Convolutional Neural Networks (CNNs) have emerged as highly successful t...
research
03/27/2023

Learning Iterative Neural Optimizers for Image Steganography

Image steganography is the process of concealing secret information in i...
research
08/29/2021

Rethinking Deep Image Prior for Denoising

Deep image prior (DIP) serves as a good inductive bias for diverse inver...

Please sign up or login with your details

Forgot password? Click here to reset