Onsager-corrected deep learning for sparse linear inverse problems

07/20/2016
by   Mark Borgerding, et al.
0

Deep learning has gained great popularity due to its widespread success on many inference problems. We consider the application of deep learning to the sparse linear inverse problem encountered in compressive sensing, where one seeks to recover a sparse signal from a small number of noisy linear measurements. In this paper, we propose a novel neural-network architecture that decouples prediction errors across layers in the same way that the approximate message passing (AMP) algorithm decouples them across iterations: through Onsager correction. Numerical experiments suggest that our "learned AMP" network significantly improves upon Gregor and LeCun's "learned ISTA" network in both accuracy and complexity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/04/2019

Deep Coupled-Representation Learning for Sparse Linear Inverse Problems with Side Information

In linear inverse problems, the goal is to recover a target signal from ...
research
03/13/2022

One-Bit Compressive Sensing: Can We Go Deep and Blind?

One-bit compressive sensing is concerned with the accurate recovery of a...
research
11/02/2020

Compressed Sensing with Upscaled Vector Approximate Message Passing

Recently proposed Vector Approximate Message Passing (VAMP) demonstrates...
research
01/22/2021

SGD-Net: Efficient Model-Based Deep Learning with Theoretical Guarantees

Deep unfolding networks have recently gained popularity in the context o...
research
03/30/2020

When to Use Convolutional Neural Networks for Inverse Problems

Reconstruction tasks in computer vision aim fundamentally to recover an ...
research
10/20/2021

Robust lEarned Shrinkage-Thresholding (REST): Robust unrolling for sparse recover

In this paper, we consider deep neural networks for solving inverse prob...
research
05/22/2022

A Deep Gradient Correction Method for Iteratively Solving Linear Systems

We present a novel deep learning approach to approximate the solution of...

Please sign up or login with your details

Forgot password? Click here to reset