AI Chat AI Image Generator AI Video Text to Speech

On Lipschitz Bounds of General Convolutional Neural Networks

08/04/2018

∙

by Dongmian Zou, et al.

∙

∙

Many convolutional neural networks (CNNs) have a feed-forward structure. In this paper, a linear program that estimates the Lipschitz bound of such CNNs is proposed. Several CNNs, including the scattering networks, the AlexNet and the GoogleNet, are studied numerically and compared to the theoretical bounds. Next, concentration inequalities of the output distribution to a stationary random input signal expressed in terms of the Lipschitz bound are established. The Lipschitz bound is further used to establish a nonlinear discriminant analysis designed to measure the separation between features of different classes.

Dongmian Zou
13 publications
Radu Balan
11 publications
Maneesh Singh
27 publications

page 13

page 14

research

∙ 03/20/2023

Lipschitz-bounded 1D convolutional neural networks using the Cayley transform and the controllability Gramian

We establish a layer-wise parameterization for 1D convolutional neural n...

0 Patricia Pauli, et al. ∙

research

∙ 07/14/2022

Lipschitz Bound Analysis of Neural Networks

Lipschitz Bound Estimation is an effective method of regularizing deep n...

9 Sarosij Bose, et al. ∙

research

∙ 11/28/2022

Lipschitz constant estimation for 1D convolutional neural networks

In this work, we propose a dissipativity-based method for Lipschitz cons...

0 Patricia Pauli, et al. ∙

research

∙ 06/13/2018

On Tighter Generalization Bound for Deep Neural Networks: CNNs, ResNets, and Beyond

Our paper proposes a generalization error bound for a general family of ...

2 Xingguo Li, et al. ∙

research

∙ 08/26/2021

Convolutional Neural Networks Demystified: A Matched Filtering Perspective Based Tutorial

Deep Neural Networks (DNN) and especially Convolutional Neural Networks ...

45 Ljubisa Stankovic, et al. ∙

research

∙ 04/24/2021

On the stability of deep convolutional neural networks under irregular or random deformations

The problem of robustness under location deformations for deep convoluti...

0 Fabio Nicola, et al. ∙

research

∙ 04/27/2020

Estimating Full Lipschitz Constants of Deep Neural Networks

We estimate the Lipschitz constants of the gradient of a deep neural net...

0 Calypso Herrera, et al. ∙