Tailored neural networks for learning optimal value functions in MPC

12/07/2021
by   Dieter Teichrib, et al.
0

Learning-based predictive control is a promising alternative to optimization-based MPC. However, efficiently learning the optimal control policy, the optimal value function, or the Q-function requires suitable function approximators. Often, artificial neural networks (ANN) are considered but choosing a suitable topology is also non-trivial. Against this background, it has recently been shown that tailored ANN allow, in principle, to exactly describe the optimal control policy in linear MPC by exploiting its piecewise affine structure. In this paper, we provide a similar result for representing the optimal value function and the Q-function that are both known to be piecewise quadratic for linear MPC.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/14/2022

Tailored max-out networks for learning convex PWQ functions

Convex piecewise quadratic (PWQ) functions frequently appear in control ...
research
04/07/2021

The Value of Planning for Infinite-Horizon Model Predictive Control

Model Predictive Control (MPC) is a classic tool for optimal control of ...
research
11/05/2019

AReN: Assured ReLU NN Architecture for Model Predictive Control of LTI Systems

In this paper, we consider the problem of automatically designing a Rect...
research
11/09/2018

Sample-Efficient Policy Learning based on Completely Behavior Cloning

Direct policy search is one of the most important algorithm of reinforce...
research
06/09/2020

In Proximity of ReLU DNN, PWA Function, and Explicit MPC

Rectifier (ReLU) deep neural networks (DNN) and their connection with pi...
research
10/01/2021

Error-free approximation of explicit linear MPC through lattice piecewise affine expression

In this paper, the disjunctive and conjunctive lattice piecewise affine ...
research
05/18/2022

Bridging the gap between QP-based and MPC-based RL

Reinforcement learning methods typically use Deep Neural Networks to app...

Please sign up or login with your details

Forgot password? Click here to reset