Provable Lipschitz Certification for Generative Models

07/06/2021
by   Matt Jordan, et al.
0

We present a scalable technique for upper bounding the Lipschitz constant of generative models. We relate this quantity to the maximal norm over the set of attainable vector-Jacobian products of a given generative model. We approximate this set by layerwise convex approximations using zonotopes. Our approach generalizes and improves upon prior work using zonotope transformers and we extend to Lipschitz estimation of neural networks with large output dimension. This provides efficient and tight bounds on small networks and can scale to generative models on VAE and DCGAN architectures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/29/2022

Can Push-forward Generative Models Fit Multimodal Distributions?

Many generative models synthesize data by transforming a standard Gaussi...
research
02/21/2023

Provable Copyright Protection for Generative Models

There is a growing concern that learned conditional generative models ma...
research
10/25/2021

Scalable Lipschitz Residual Networks with Convex Potential Flows

The Lipschitz constant of neural networks has been established as a key ...
research
05/28/2018

Lipschitz regularity of deep neural networks: analysis and efficient estimation

Deep neural networks are notorious for being sensitive to small well-cho...
research
11/03/2019

Preventing Gradient Attenuation in Lipschitz Constrained Convolutional Networks

Lipschitz constraints under L2 norm on deep neural networks are useful f...
research
10/26/2020

Reducing the Computational Cost of Deep Generative Models with Binary Neural Networks

Deep generative models provide a powerful set of tools to understand rea...
research
03/16/2022

On the sensitivity of pose estimation neural networks: rotation parameterizations, Lipschitz constants, and provable bounds

In this paper, we approach the task of determining sensitivity bounds fo...

Please sign up or login with your details

Forgot password? Click here to reset