Neural Network Robustness Verification on GPUs

07/20/2020
by   Christoph Muller, et al.
26

Certifying the robustness of neural networks against adversarial attacks is critical to their reliable adoption in real-world systems including autonomous driving and medical diagnosis. Unfortunately, state-of-the-art verifiers either do not scale to larger networks or are too imprecise to prove robustness, which limits their practical adoption. In this work, we introduce GPUPoly, a scalable verifier that can prove the robustness of significantly larger deep neural networks than possible with prior work. The key insight behind GPUPoly is the design of custom, sound polyhedra algorithms for neural network verification on a GPU. Our algorithms leverage the available GPU parallelism and the inherent sparsity of the underlying neural network verification task. GPUPoly scales to very large networks: for example, it can prove the robustness of a 1M neuron, 34-layer deep residual network in about 1 minute. We believe GPUPoly is a promising step towards the practical verification of large real-world networks.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

06/18/2021

Residual Error: a New Performance Measure for Adversarial Robustness

Despite the significant advances in deep learning over the past decade, ...
10/25/2019

Simplifying Neural Networks with the Marabou Verification Engine

Deep neural network (DNN) verification is an emerging field, with divers...
09/09/2020

SoK: Certified Robustness for Deep Neural Networks

Great advancement in deep neural networks (DNNs) has led to state-of-the...
06/24/2021

Online Verification of Deep Neural Networks under Domain or Weight Shift

Although neural networks are widely used, it remains challenging to form...
05/07/2020

Efficient Exact Verification of Binarized Neural Networks

Concerned with the reliability of neural networks, researchers have deve...
03/02/2022

Neuro-Symbolic Verification of Deep Neural Networks

Formal verification has emerged as a powerful approach to ensure the saf...
03/05/2021

Precise Multi-Neuron Abstractions for Neural Network Certification

Formal verification of neural networks is critical for their safe adopti...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.