Verifying Global Neural Network Specifications using Hyperproperties

06/21/2023
by   David Boetius, et al.
0

Current approaches to neural network verification focus on specifications that target small regions around known input data points, such as local robustness. Thus, using these approaches, we can not obtain guarantees for inputs that are not close to known inputs. Yet, it is highly likely that a neural network will encounter such truly unseen inputs during its application. We study global specifications that - when satisfied - provide guarantees for all potential inputs. We introduce a hyperproperty formalism that allows for expressing global specifications such as monotonicity, Lipschitz continuity, global robustness, and dependency fairness. Our formalism enables verifying global specifications using existing neural network verification approaches by leveraging capabilities for verifying general computational graphs. Thereby, we extend the scope of guarantees that can be provided using existing methods. Recent success in verifying specific global specifications shows that attaining strong guarantees for all potential data points is feasible.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/17/2018

A Dual Approach to Scalable Verification of Deep Networks

This paper addresses the problem of formally verifying desirable propert...
research
10/28/2022

Toward Reliable Neural Specifications

Having reliable specifications is an unavoidable challenge in achieving ...
research
12/02/2018

Verifying Fairness Properties via Concentration

As machine learning systems are increasingly used to make real world leg...
research
02/18/2021

Verifying Probabilistic Specifications with Functional Lagrangians

We propose a general framework for verifying input-output specifications...
research
01/27/2018

Interactive Deep Colorization With Simultaneous Global and Local Inputs

Colorization methods using deep neural networks have become a recent tre...
research
09/01/2021

Shared Certificates for Neural Network Verification

Existing neural network verifiers compute a proof that each input is han...
research
09/25/2021

Auditing AI models for Verified Deployment under Semantic Specifications

Auditing trained deep learning (DL) models prior to deployment is vital ...

Please sign up or login with your details

Forgot password? Click here to reset