DeepAI AI Chat
Log In Sign Up

Branch and Bound for Piecewise Linear Neural Network Verification

by   Rudy Bunel, et al.

The success of Deep Learning and its potential use in many safety-critical applications has motivated research on formal verification of Neural Network (NN) models. In this context, verification means verifying whether a NN model satisfies certain input-output properties. Despite the reputation of learned NN models as black boxes, and the theoretical hardness of proving useful properties about them, researchers have been successful in verifying some classes of models by exploiting their piecewise linear structure and taking insights from formal methods such as Satisifiability Modulo Theory. However, these methods are still far from scaling to realistic neural networks. To facilitate progress on this crucial area, we make two key contributions. First, we present a unified framework based on branch and bound that encompasses previous methods. This analysis results in the identification of new methods that combine the strengths of multiple existing approaches, accomplishing a speedup of two orders of magnitude compared to the previous state of the art. Second, we propose a new data set of benchmarks which includes a collection of previously released test cases. We use the benchmark to provide a thorough experimental comparison of existing algorithms and identify the factors impacting the hardness of verification problems.


page 1

page 2

page 3

page 4


Piecewise Linear Neural Network verification: A comparative study

The success of Deep Learning and its potential use in many important saf...

Neural Network Branching for Neural Network Verification

Formal verification of neural networks is essential for their deployment...

Algorithms for Verifying Deep Neural Networks

Deep neural networks are widely used for nonlinear function approximatio...

NNLander-VeriF: A Neural Network Formal Verification Framework for Vision-Based Autonomous Aircraft Landing

In this paper, we consider the problem of formally verifying a Neural Ne...

Geometric Path Enumeration for Equivalence Verification of Neural Networks

As neural networks (NNs) are increasingly introduced into safety-critica...

Automated Formal Synthesis of Neural Barrier Certificates for Dynamical Models

We introduce an automated, formal, counterexample-based approach to synt...

A Unified View of SDP-based Neural Network Verification through Completely Positive Programming

Verifying that input-output relationships of a neural network conform to...