Fast Falsification of Neural Networks using Property Directed Testing

04/26/2021
by   Moumita Das, et al.
0

Neural networks are now extensively used in perception, prediction and control of autonomous systems. Their deployment in safety-critical systems brings forth the need for verification techniques for such networks. As an alternative to exhaustive and costly verification algorithms, lightweight falsification algorithms have been heavily used to search for an input to the system that produces an unsafe output, i.e., a counterexample to the safety of the system. In this work, we propose a falsification algorithm for neural networks that directs the search for a counterexample, guided by a safety property specification. Our algorithm uses a derivative-free sampling-based optimization method. We evaluate our algorithm on 45 trained neural network benchmarks of the ACAS Xu system against 10 safety properties. We show that our falsification procedure detects all the unsafe instances that other verification tools also report as unsafe. Moreover, in terms of performance, our falsification procedure identifies most of the unsafe instances faster, in comparison to the state-of-the-art verification tools for feed-forward neural networks such as NNENUM and Neurify and in many instances, by orders of magnitude.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/18/2018

Toward Scalable Verification for Safety-Critical Deep Networks

The increasing use of deep neural networks for safety-critical applicati...
research
12/03/2020

Towards Repairing Neural Networks Correctly

Neural networks are increasingly applied to support decision making in s...
research
04/09/2019

Towards Safety Verification of Direct Perception Neural Networks

We study the problem of safety verification of direct perception neural ...
research
12/15/2022

Optimized Symbolic Interval Propagation for Neural Network Verification

Neural networks are increasingly applied in safety critical domains, the...
research
01/16/2022

Solving Inventory Management Problems with Inventory-dynamics-informed Neural Networks

A key challenge in inventory management is to identify policies that opt...
research
09/21/2020

NeuroDiff: Scalable Differential Verification of Neural Networks using Fine-Grained Approximation

As neural networks make their way into safety-critical systems, where mi...
research
06/27/2023

Verifying Safety of Neural Networks from Topological Perspectives

Neural networks (NNs) are increasingly applied in safety-critical system...

Please sign up or login with your details

Forgot password? Click here to reset