Optimization + Abstraction: A Synergistic Approach for Analyzing Neural Network Robustness

04/22/2019
by   Greg Anderson, et al.
0

In recent years, the notion of local robustness (or robustness for short) has emerged as a desirable property of deep neural networks. Intuitively, robustness means that small perturbations to an input do not cause the network to perform misclassifications. In this paper, we present a novel algorithm for verifying robustness properties of neural networks. Our method synergistically combines gradient-based optimization methods for counterexample search with abstraction-based proof search to obtain a sound and (δ-)complete decision procedure. Our method also employs a data-driven approach to learn a verification policy that guides abstract interpretation during proof search. We have implemented the proposed approach in a tool called Charon and experimentally evaluated it on hundreds of benchmarks. Our experiments show that the proposed approach significantly outperforms three state-of-the-art tools, namely AI^2 , Reluplex, and Reluval.

READ FULL TEXT
research
04/22/2019

Optimization and Abstraction: A Synergistic Approach for Analyzing Neural Network Robustness

In recent years, the notion of local robustness (or robustness for short...
research
04/26/2019

Robustness Verification of Support Vector Machines

We study the problem of formally verifying the robustness to adversarial...
research
02/15/2019

Robustness of Neural Networks: A Probabilistic and Practical Approach

Neural networks are becoming increasingly prevalent in software, and it ...
research
06/26/2019

Verifying Robustness of Gradient Boosted Models

Gradient boosted models are a fundamental machine learning technique. Ro...
research
09/13/2022

A Robust Scientific Machine Learning for Optimization: A Novel Robustness Theorem

Scientific machine learning (SciML) is a field of increasing interest in...
research
03/21/2023

Boosting Verified Training for Robust Image Classifications via Abstraction

This paper proposes a novel, abstraction-based, certified training metho...
research
02/22/2020

Robustness to Programmable String Transformations via Augmented Abstract Training

Deep neural networks for natural language processing tasks are vulnerabl...

Please sign up or login with your details

Forgot password? Click here to reset