Improving Neural Network Verification through Spurious Region Guided Refinement

10/15/2020
by   Pengfei Yang, et al.
0

We propose a spurious region guided refinement approach for robustness verification of deep neural networks. Our method starts with applying the DeepPoly abstract domain to analyze the network. If the robustness property cannot be verified, the result is inconclusive. Due to the over-approximation, the computed region in the abstraction may be spurious in the sense that it does not contain any true counterexample. Our goal is to identify such spurious regions and use them to guide the abstraction refinement. The core idea is to make use of the obtained constraints of the abstraction to infer new bounds for the neurons. This is achieved by linear programming techniques. With the new bounds, we iteratively apply DeepPoly, aiming to eliminate spurious regions. We have implemented our approach in a prototypical tool DeepSRGR. Experimental results show that a large amount of regions can be identified as spurious, and as a result, the precision of DeepPoly can be significantly improved. As a side contribution, we show that our approach can be applied to verify quantitative robustness properties.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/02/2022

Abstraction and Refinement: Towards Scalable and Exact Verification of Neural Networks

As a new programming paradigm, deep neural networks (DNNs) have been inc...
research
07/20/2023

Syntactic vs Semantic Linear Abstraction and Refinement of Neural Networks

Abstraction is a key verification technique to improve scalability. Howe...
research
07/17/2019

ART: Abstraction Refinement-Guided Training for Provably Correct Neural Networks

Artificial Neural Networks (ANNs) have demonstrated remarkable utility i...
research
05/05/2023

On Preimage Approximation for Neural Networks

Neural network verification mainly focuses on local robustness propertie...
research
12/05/2017

Partial Predicate Abstraction and Counter-Example Guided Refinement

In this paper we present a counter-example guided abstraction and approx...
research
05/17/2021

DISCO Verification: Division of Input Space into COnvex polytopes for neural network verification

The impressive results of modern neural networks partly come from their ...
research
01/06/2022

An Abstraction-Refinement Approach to Verifying Convolutional Neural Networks

Convolutional neural networks have gained vast popularity due to their e...

Please sign up or login with your details

Forgot password? Click here to reset