DeepAI AI Chat
Log In Sign Up

Robustness against Adversarial Attacks in Neural Networks using Incremental Dissipativity

11/25/2021
by   Bernardo Aquino, et al.
University of Michigan
University of Notre Dame
6

Adversarial examples can easily degrade the classification performance in neural networks. Empirical methods for promoting robustness to such examples have been proposed, but often lack both analytical insights and formal guarantees. Recently, some robustness certificates have appeared in the literature based on system theoretic notions. This work proposes an incremental dissipativity-based robustness certificate for neural networks in the form of a linear matrix inequality for each layer. We also propose an equivalent spectral norm bound for this certificate which is scalable to neural networks with multiple layers. We demonstrate the improved performance against adversarial attacks on a feed-forward neural network trained on MNIST and an Alexnet trained using CIFAR-10.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/19/2018

Robustness of Rotation-Equivariant Networks to Adversarial Perturbations

Deep neural networks have been shown to be vulnerable to adversarial exa...
11/30/2017

Convolutional Networks with Adaptive Computation Graphs

Do convolutional networks really need a fixed feed-forward structure? Of...
02/24/2021

Multiplicative Reweighting for Robust Neural Network Optimization

Deep neural networks are widespread due to their powerful performance. Y...
05/17/2019

POPQORN: Quantifying Robustness of Recurrent Neural Networks

The vulnerability to adversarial attacks has been a critical issue for d...
07/25/2018

Unbounded Output Networks for Classification

We proposed the expected energy-based restricted Boltzmann machine (EE-R...
05/16/2023

Ortho-ODE: Enhancing Robustness and of Neural ODEs against Adversarial Attacks

Neural Ordinary Differential Equations (NODEs) probed the usage of numer...
02/26/2018

Retrieval-Augmented Convolutional Neural Networks for Improved Robustness against Adversarial Examples

We propose a retrieval-augmented convolutional network and propose to tr...