Convergence and Recovery Guarantees of Unsupervised Neural Networks for Inverse Problems

09/21/2023
by   Nathan Buskulic, et al.
0

Neural networks have become a prominent approach to solve inverse problems in recent years. While a plethora of such methods was developed to solve inverse problems empirically, we are still lacking clear theoretical guarantees for these methods. On the other hand, many works proved convergence to optimal solutions of neural networks in a more general setting using overparametrization as a way to control the Neural Tangent Kernel. In this work we investigate how to bridge these two worlds and we provide deterministic convergence and recovery guarantees for the class of unsupervised feedforward multilayer neural networks trained to solve inverse problems. We also derive overparametrization bounds under which a two-layers Deep Inverse Prior network with smooth activation function will benefit from our guarantees.

READ FULL TEXT
research
03/20/2023

Convergence Guarantees of Overparametrized Wide Deep Inverse Prior

Neural networks have become a prominent approach to solve inverse proble...
research
07/20/2018

Convolutional Neural Networks Analyzed via Inverse Problem Theory and Sparse Representations

Inverse problems in imaging such as denoising, deblurring, superresoluti...
research
01/26/2021

Benchmarking Invertible Architectures on Inverse Problems

Recent work demonstrated that flow-based invertible neural networks are ...
research
12/11/2019

Two Birds with One Stone: Investigating Invertible Neural Networks for Inverse Problems in Morphology

Most problems in natural language processing can be approximated as inve...
research
05/16/2019

AlgoNet: C^∞ Smooth Algorithmic Neural Networks

Artificial neural networks revolutionized many areas of computer science...
research
06/18/2019

Boosting CNN beyond Label in Inverse Problems

Convolutional neural networks (CNN) have been extensively used for inver...
research
08/05/2023

Approximating Positive Homogeneous Functions with Scale Invariant Neural Networks

We investigate to what extent it is possible to solve linear inverse pro...

Please sign up or login with your details

Forgot password? Click here to reset