Effective Certification of Monotone Deep Equilibrium Models

by   Mark Niklas Müller, et al.

Monotone Operator Equilibrium Models (monDEQs) represent a class of models combining the powerful deep equilibrium paradigm with convergence guarantees. Further, their inherent robustness to adversarial perturbations makes investigating their certifiability a promising research direction. Unfortunately, existing approaches are either imprecise or severely limited in scalability. In this work, we propose the first scalable and precise monDEQ verifier, based on two key ideas: (i) a novel convex relaxation enabling efficient inclusion checks, and (ii) non-trivial mathematical insights characterizing the fixpoint operations at the heart of monDEQs on sets rather than concrete inputs. An extensive evaluation of our verifier on the challenging ℓ_∞ perturbations demonstrates that it exceeds state-of-the-art performance in terms of speed (two orders of magnitude) and scalability (an order of magnitude) while yielding 25 accuracies on the same networks.



There are no comments yet.


page 1

page 2

page 3

page 4


Monotone operator equilibrium networks

Implicit-depth models such as Deep Equilibrium Networks have recently be...

Improved Model based Deep Learning using Monotone Operator Learning (MOL)

Model-based deep learning (MoDL) algorithms that rely on unrolling are e...

Fast and Effective Robustness Certification for Recurrent Neural Networks

We present a precise and scalable verifier for recurrent neural networks...

A relaxed-inertial forward-backward-forward algorithm for Stochastic Generalized Nash equilibrium seeking

In this paper we propose a new operator splitting algorithm for distribu...

The Nonstochastic Control Problem

We consider the problem of controlling an unknown linear dynamical syste...

Robustness Certificates for Implicit Neural Networks: A Mixed Monotone Contractive Approach

Implicit neural networks are a general class of learning models that rep...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.