One-dimensional Deep Image Prior for Time Series Inverse Problems

04/18/2019
by   Sriram Ravula, et al.
18

We extend the Deep Image Prior (DIP) framework to one-dimensional signals. DIP is using a randomly initialized convolutional neural network (CNN) to solve linear inverse problems by optimizing over weights to fit the observed measurements. Our main finding is that properly tuned one-dimensional convolutional architectures provide an excellent Deep Image Prior for various types of temporal signals including audio, biological signals, and sensor measurements. We show that our network can be used in a variety of recovery tasks including missing value imputation, blind denoising, and compressed sensing from random Gaussian projections. The key challenge is how to avoid overfitting by carefully tuning early stopping, total variation, and weight decay regularization. Our method requires up to 4 times fewer measurements than Lasso and outperforms NLM-VAMP for random Gaussian measurements on audio signals, has similar imputation performance to a Kalman state-space model on a variety of data, and outperforms wavelet filtering in removing additive noise from air-quality sensor readings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/07/2020

Compressive sensing with un-trained neural networks: Gradient descent finds the smoothest approximation

Un-trained convolutional neural networks have emerged as highly successf...
research
03/18/2020

Compressed Sensing with Invertible Generative Models and Dependent Noise

We study image inverse problems with invertible generative priors, speci...
research
07/06/2019

Regularizing linear inverse problems with convolutional neural networks

Deep convolutional neural networks trained on large datsets have emerged...
research
06/17/2018

Compressed Sensing with Deep Image Prior and Learned Regularization

We propose a novel method for compressed sensing recovery using untraine...
research
11/03/2020

Solving Inverse Problems with Hybrid Deep Image Priors: the challenge of preventing overfitting

We mainly analyze and solve the overfitting problem of deep image prior ...
research
12/07/2017

MoDL: Model Based Deep Learning Architecture for Inverse Problems

We introduce a model-based image reconstruction framework with a convolu...
research
11/09/2020

Solving Inverse Problems With Deep Neural Networks – Robustness Included?

In the past five years, deep learning methods have become state-of-the-a...

Please sign up or login with your details

Forgot password? Click here to reset