Continuous Generative Neural Networks

05/29/2022
by   Giovanni S. Alberti, et al.
22

In this work, we present and study Continuous Generative Neural Networks (CGNNs), namely, generative models in the continuous setting. The architecture is inspired by DCGAN, with one fully connected layer, several convolutional layers and nonlinear activation functions. In the continuous L^2 setting, the dimensions of the spaces of each layer are replaced by the scales of a multiresolution analysis of a compactly supported wavelet. We present conditions on the convolutional filters and on the nonlinearity that guarantee that a CGNN is injective. This theory finds applications to inverse problems, and allows for deriving Lipschitz stability estimates for (possibly nonlinear) infinite-dimensional inverse problems with unknowns belonging to the manifold generated by a CGNN. Several numerical simulations, including image deblurring, illustrate and validate this approach.

READ FULL TEXT

page 11

page 12

page 33

research
06/15/2020

Globally Injective ReLU Networks

We study injective ReLU neural networks. Injectivity plays an important ...
research
10/23/2019

Low Shot Learning with Untrained Neural Networks for Imaging Inverse Problems

Employing deep neural networks as natural image priors to solve inverse ...
research
11/28/2022

Lipschitz constant estimation for 1D convolutional neural networks

In this work, we propose a dissipativity-based method for Lipschitz cons...
research
09/07/2020

Stabilizing Invertible Neural Networks Using Mixture Models

In this paper, we analyze the properties of invertible neural networks, ...
research
08/28/2022

Neural Network Approximation of Lipschitz Functions in High Dimensions with Applications to Inverse Problems

The remarkable successes of neural networks in a huge variety of inverse...
research
10/05/2019

Minimum "Norm" Neural Networks are Splines

We develop a general framework based on splines to understand the interp...
research
03/25/2018

SUNLayer: Stable denoising with generative networks

It has been experimentally established that deep neural networks can be ...

Please sign up or login with your details

Forgot password? Click here to reset