Online Verification of Deep Neural Networks under Domain or Weight Shift

by   Tianhao Wei, et al.

Although neural networks are widely used, it remains challenging to formally verify the safety and robustness of neural networks in real-world applications. Existing methods are designed to verify the network before use, which is limited to relatively simple specifications and fixed networks. These methods are not ready to be applied to real-world problems with complex and/or dynamically changing specifications and networks. To effectively handle dynamically changing specifications and networks, the verification needs to be performed online when these changes take place. However, it is still challenging to run existing verification algorithms online. Our key insight is that we can leverage the temporal dependencies of these changes to accelerate the verification process, e.g., by warm starting new online verification using previous verified results. This paper establishes a novel framework for scalable online verification to solve real-world verification problems with dynamically changing specifications and/or networks, known as domain shift and weight shift respectively. We propose three types of techniques (branch management, perturbation tolerance analysis, and incremental computation) to accelerate the online verification of deep neural networks. Experiment results show that our online verification algorithm is up to two orders of magnitude faster than existing verification algorithms, and thus can scale to real-world applications.



There are no comments yet.


page 1

page 2

page 3

page 4


Neural Network Robustness Verification on GPUs

Certifying the robustness of neural networks against adversarial attacks...

Voter Verification of BMD Ballots Is a Two-Part Question: Can They? Mostly, They Can. Do They? Mostly, They Don't

The question of whether or not voters actually verify ballots produced b...

Verification of Neural Networks: Enhancing Scalability through Pruning

Verification of deep neural networks has witnessed a recent surge of int...

Scalable Verification of Quantized Neural Networks (Technical Report)

Formal verification of neural networks is an active topic of research, a...

Towards Repairing Neural Networks Correctly

Neural networks are increasingly applied to support decision making in s...

Effective Formal Verification of Neural Networks using the Geometry of Linear Regions

Neural Networks (NNs) have increasingly apparent safety implications com...

Regulating Ownership Verification for Deep Neural Networks: Scenarios, Protocols, and Prospects

With the broad application of deep neural networks, the necessity of pro...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.