Stability Verification of Neural Network Controllers using Mixed-Integer Programming

06/27/2022
by   Roland Schwan, et al.
44

We propose a framework for the stability verification of Mixed-Integer Linear Programming (MILP) representable control policies. This framework compares a fixed candidate policy, which admits an efficient parameterization and can be evaluated at a low computational cost, against a fixed baseline policy, which is known to be stable but expensive to evaluate. We provide sufficient conditions for the closed-loop stability of the candidate policy in terms of the worst-case approximation error with respect to the baseline policy, and we show that these conditions can be checked by solving a Mixed-Integer Quadratic Program (MIQP). Additionally, we demonstrate that an outer approximation of the stability region of the candidate policy can be computed by solving an MILP. The proposed framework is sufficiently general to accommodate a broad range of candidate policies including ReLU Neural Networks (NNs), optimal solution maps of parametric quadratic programs, and Model Predictive Control (MPC) policies. We also present an open-source toolbox in Python based on the proposed framework, which allows for the easy verification of custom NN architectures and MPC formulations. We showcase the flexibility and reliability of our framework in the context of a DC-DC power convertor case study and investigate the computational complexity.

READ FULL TEXT

page 9

page 10

page 11

page 12

research
11/13/2021

Reliably-stabilizing piecewise-affine neural network controllers

A common problem affecting neural network (NN) approximations of model p...
research
04/27/2022

Neural network controllers for uncertain linear systems

We consider the design of reliable neural network (NN)-based approximati...
research
09/29/2021

Lyapunov-stable neural-network control

Deep learning has had a far reaching impact in robotics. Specifically, d...
research
04/03/2020

Reinforcement Learning for Mixed-Integer Problems Based on MPC

Model Predictive Control has been recently proposed as policy approximat...
research
11/20/2019

Fast Non-Parametric Learning to Accelerate Mixed-Integer Programming for Online Hybrid Model Predictive Control

Today's fast linear algebra and numerical optimization tools have pushed...
research
07/23/2023

Robust explicit model predictive control for hybrid linear systems with parameter uncertainties

Explicit model-predictive control (MPC) is a widely used control design ...
research
02/15/2023

Variable Selection for Kernel Two-Sample Tests

We consider the variable selection problem for two-sample tests, aiming ...

Please sign up or login with your details

Forgot password? Click here to reset