SGD-Net: Efficient Model-Based Deep Learning with Theoretical Guarantees

01/22/2021
by   Jiaming Liu, et al.
38

Deep unfolding networks have recently gained popularity in the context of solving imaging inverse problems. However, the computational and memory complexity of data-consistency layers within traditional deep unfolding networks scales with the number of measurements, limiting their applicability to large-scale imaging inverse problems. We propose SGD-Net as a new methodology for improving the efficiency of deep unfolding through stochastic approximations of the data-consistency layers. Our theoretical analysis shows that SGD-Net can be trained to approximate batch deep unfolding networks to an arbitrary precision. Our numerical results on intensity diffraction tomography and sparse-view computed tomography show that SGD-Net can match the performance of the batch network at a fraction of training and testing complexity.

READ FULL TEXT

page 8

page 10

page 13

research
02/10/2023

On the Convergence of Stochastic Gradient Descent for Linear Inverse Problems in Banach Spaces

In this work we consider stochastic gradient descent (SGD) for solving l...
research
01/06/2020

Deep Learning-Based Solvability of Underdetermined Inverse Problems in Medical Imaging

Recently, with the significant developments in deep learning techniques,...
research
02/28/2018

NETT: Solving Inverse Problems with Deep Neural Networks

Recovering a function or high-dimensional parameter vector from indirect...
research
09/12/2023

Data-proximal null-space networks for inverse problems

Inverse problems are inherently ill-posed and therefore require regulari...
research
11/25/2019

Solving Traveltime Tomography with Deep Learning

This paper introduces a neural network approach for solving two-dimensio...
research
07/20/2016

Onsager-corrected deep learning for sparse linear inverse problems

Deep learning has gained great popularity due to its widespread success ...
research
08/13/2020

Deep Networks with Fast Retraining

Recent wor [1] has utilized Moore-Penrose (MP) inverse in deep convoluti...

Please sign up or login with your details

Forgot password? Click here to reset