A Mixed Integer Programming Approach for Verifying Properties of Binarized Neural Networks

03/11/2022
by   Christopher Lazarus, et al.
0

Many approaches for verifying input-output properties of neural networks have been proposed recently. However, existing algorithms do not scale well to large networks. Recent work in the field of model compression studied binarized neural networks (BNNs), whose parameters and activations are binary. BNNs tend to exhibit a slight decrease in performance compared to their full-precision counterparts, but they can be easier to verify. This paper proposes a simple mixed integer programming formulation for BNN verification that leverages network structure. We demonstrate our approach by verifying properties of BNNs trained on the MNIST dataset and an aircraft collision avoidance controller. We compare the runtime of our approach against state-of-the-art verification algorithms for full-precision neural networks. The results suggest that the difficulty of training BNNs might be worth the reduction in runtime achieved by our verification algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/15/2019

Algorithms for Verifying Deep Neural Networks

Deep neural networks are widely used for nonlinear function approximatio...
research
09/26/2017

Output Range Analysis for Deep Neural Networks

Deep neural networks (NN) are extensively used for machine learning task...
research
08/19/2020

ReLU activated Multi-Layer Neural Networks trained with Mixed Integer Linear Programs

This paper is a case study to demonstrate that, in principle, multi-laye...
research
02/17/2020

Identifying Critical Neurons in ANN Architectures using Mixed Integer Programming

We introduce a novel approach to optimize the architecture of deep neura...
research
12/07/2022

The BeMi Stardust: a Structured Ensemble of Binarized Neural Networks

Binarized Neural Networks (BNNs) are receiving increasing attention due ...
research
09/08/2020

On Training Neural Networks with Mixed Integer Programming

Recent work has shown potential in using Mixed Integer Programming (MIP)...
research
10/08/2018

Combinatorial Attacks on Binarized Neural Networks

Binarized Neural Networks (BNNs) have recently attracted significant int...

Please sign up or login with your details

Forgot password? Click here to reset