Effective Certification of Monotone Deep Equilibrium Models

10/14/2021
by   Mark Niklas Müller, et al.
0

Monotone Operator Equilibrium Models (monDEQs) represent a class of models combining the powerful deep equilibrium paradigm with convergence guarantees. Further, their inherent robustness to adversarial perturbations makes investigating their certifiability a promising research direction. Unfortunately, existing approaches are either imprecise or severely limited in scalability. In this work, we propose the first scalable and precise monDEQ verifier, based on two key ideas: (i) a novel convex relaxation enabling efficient inclusion checks, and (ii) non-trivial mathematical insights characterizing the fixpoint operations at the heart of monDEQs on sets rather than concrete inputs. An extensive evaluation of our verifier on the challenging ℓ_∞ perturbations demonstrates that it exceeds state-of-the-art performance in terms of speed (two orders of magnitude) and scalability (an order of magnitude) while yielding 25 accuracies on the same networks.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

06/15/2020

Monotone operator equilibrium networks

Implicit-depth models such as Deep Equilibrium Networks have recently be...
11/22/2021

Improved Model based Deep Learning using Monotone Operator Learning (MOL)

Model-based deep learning (MoDL) algorithms that rely on unrolling are e...
05/27/2020

Fast and Effective Robustness Certification for Recurrent Neural Networks

We present a precise and scalable verifier for recurrent neural networks...
03/24/2021

A relaxed-inertial forward-backward-forward algorithm for Stochastic Generalized Nash equilibrium seeking

In this paper we propose a new operator splitting algorithm for distribu...
11/27/2019

The Nonstochastic Control Problem

We consider the problem of controlling an unknown linear dynamical syste...
12/10/2021

Robustness Certificates for Implicit Neural Networks: A Mixed Monotone Contractive Approach

Implicit neural networks are a general class of learning models that rep...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.