DeepAI AI Chat
Log In Sign Up

Self-Repairing Neural Networks: Provable Safety for Deep Networks via Dynamic Repair

by   Klas Leino, et al.
Carnegie Mellon University

Neural networks are increasingly being deployed in contexts where safety is a critical concern. In this work, we propose a way to construct neural network classifiers that dynamically repair violations of non-relational safety constraints called safe ordering properties. Safe ordering properties relate requirements on the ordering of a network's output indices to conditions on their input, and are sufficient to express most useful notions of non-relational safety for classifiers. Our approach is based on a novel self-repairing layer, which provably yields safe outputs regardless of the characteristics of its input. We compose this layer with an existing network to construct a self-repairing network (SR-Net), and show that in addition to providing safe outputs, the SR-Net is guaranteed to preserve the accuracy of the original network. Notably, our approach is independent of the size and architecture of the network being repaired, depending only on the specified property and the dimension of the network's output; thus it is scalable to large state-of-the-art networks. We show that our approach can be implemented using vectorized computations that execute efficiently on a GPU, introducing run-time overhead of less than one millisecond on current hardware – even on large, widely-used networks containing hundreds of thousands of neurons and millions of parameters.


page 1

page 2

page 3

page 4


Provable Repair of Deep Neural Networks

Deep Neural Networks (DNNs) have grown in popularity over the past decad...

Finding Input Characterizations for Output Properties in ReLU Neural Networks

Deep Neural Networks (DNNs) have emerged as a powerful mechanism and are...

Sample-Specific Output Constraints for Neural Networks

Neural networks reach state-of-the-art performance in a variety of learn...

Automated Repair of Neural Networks

Over the last decade, Neural Networks (NNs) have been widely used in num...

Causality-based Neural Network Repair

Neural networks have had discernible achievements in a wide range of app...

It's Time to Play Safe: Shield Synthesis for Timed Systems

Erroneous behaviour in safety critical real-time systems may inflict ser...

Efficient Adversarial Input Generation via Neural Net Patching

The adversarial input generation problem has become central in establish...