BDD4BNN: A BDD-based Quantitative Analysis Framework for Binarized Neural Networks

03/12/2021
by   Yedi Zhang, et al.
0

Verifying and explaining the behavior of neural networks is becoming increasingly important, especially when they are deployed in safety-critical applications. In this paper, we study verification problems for Binarized Neural Networks (BNNs), the 1-bit quantization of general real-numbered neural networks. Our approach is to encode BNNs into Binary Decision Diagrams (BDDs), which is done by exploiting the internal structure of the BNNs. In particular, we translate the input-output relation of blocks in BNNs to cardinality constraints which are then encoded by BDDs. Based on the encoding, we develop a quantitative verification framework for BNNs where precise and comprehensive analysis of BNNs can be performed. We demonstrate the application of our framework by providing quantitative robustness analysis and interpretability for BNNs. We implement a prototype tool BDD4BNN and carry out extensive experiments which confirm the effectiveness and efficiency of our approach.

READ FULL TEXT

page 17

page 19

page 30

research
06/25/2019

Quantitative Verification of Neural Networks And its Security Applications

Neural networks are increasingly employed in safety-critical domains. Th...
research
03/26/2022

Efficient Global Robustness Certification of Neural Networks via Interleaving Twin-Network Encoding

The robustness of deep neural networks has received significant interest...
research
04/05/2020

On Tractable Representations of Binary Neural Networks

We consider the compilation of a binary neural network's decision functi...
research
12/10/2022

QVIP: An ILP-based Formal Verification Approach for Quantized Neural Networks

Deep learning has become a promising programming paradigm in software de...
research
12/06/2022

QEBVerif: Quantization Error Bound Verification of Neural Networks

While deep neural networks (DNNs) have demonstrated impressive performan...
research
01/14/2023

First Three Years of the International Verification of Neural Networks Competition (VNN-COMP)

This paper presents a summary and meta-analysis of the first three itera...
research
08/24/2019

A Precise and Expressive Lattice-theoretical Framework for Efficient Network Verification

Network verification promises to detect errors, such as black holes and ...

Please sign up or login with your details

Forgot password? Click here to reset