Safe and Near-Optimal Policy Learning for Model Predictive Control using Primal-Dual Neural Networks

06/19/2019
by   Xiaojing Zhang, et al.
0

In this paper, we propose a novel framework for approximating the explicit MPC law for linear parameter-varying systems using supervised learning. In contrast to most existing approaches, we not only learn the control policy, but also a "certificate policy", that allows us to estimate the sub-optimality of the learned control policy online, during execution-time. We learn both these policies from data using supervised learning techniques, and also provide a randomized method that allows us to guarantee the quality of each learned policy, measured in terms of feasibility and optimality. This in turn allows us to bound the probability of the learned control policy of being infeasible or suboptimal, where the check is performed by the certificate policy. Since our algorithm does not require the solution of an optimization problem during run-time, it can be deployed even on resource-constrained systems. We illustrate the efficacy of the proposed framework on a vehicle dynamics control problem where we demonstrate a speedup of up to two orders of magnitude compared to online optimization with minimal performance degradation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/23/2020

Constrained Physics-Informed Deep Learning for Stable System Identification and Control of Linear Systems

This paper presents a novel data-driven method for learning deep constra...
research
04/23/2020

Constrained Physics-Informed Deep Learning for Stable System Identification and Control of Unknown Linear Systems

This paper presents a novel data-driven method for learning deep constra...
research
01/28/2022

Constrained Variational Policy Optimization for Safe Reinforcement Learning

Safe reinforcement learning (RL) aims to learn policies that satisfy cer...
research
11/18/2022

Policy Learning for Nonlinear Model Predictive Control with Application to USVs

The unaffordable computation load of nonlinear model predictive control ...
research
04/11/2022

Towards Painless Policy Optimization for Constrained MDPs

We study policy optimization in an infinite horizon, γ-discounted constr...
research
02/23/2021

Recurrent Model Predictive Control

This paper proposes an off-line algorithm, called Recurrent Model Predic...
research
09/11/2019

MPC-Net: A First Principles Guided Policy Search

We present an Imitation Learning approach for the control of dynamical s...

Please sign up or login with your details

Forgot password? Click here to reset