ABC-LMPC: Safe Sample-Based Learning MPC for Stochastic Nonlinear Dynamical Systems with Adjustable Boundary Conditions

03/03/2020
by   Brijen Thananjeyan, et al.
0

Sample-based learning model predictive control (LMPC) strategies have recently attracted attention due to their desirable theoretical properties and their good empirical performance on robotic tasks. However, prior analysis of LMPC controllers for stochastic systems has mainly focused on linear systems in the iterative learning control setting. We present a novel LMPC algorithm, Adjustable Boundary Condition LMPC (ABC-LMPC), which enables rapid adaptation to novel start and goal configurations and theoretically show that the resulting controller guarantees iterative improvement in expectation for stochastic nonlinear systems. We present results with a practical instantiation of this algorithm and experimentally demonstrate that the resulting controller adapts to a variety of initial and terminal conditions on 3 stochastic continuous control tasks.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

10/24/2019

Robust Model Predictive Shielding for Safe Reinforcement Learning with Stochastic Dynamics

This paper proposes a framework for safe reinforcement learning that can...
07/28/2021

Competitive Control

We consider control from the perspective of competitive analysis. Unlike...
05/17/2021

Koopman NMPC: Koopman-based Learning and Nonlinear Model Predictive Control of Control-affine Systems

Koopman-based learning methods can potentially be practical and powerful...
10/20/2021

Quadrotor Trajectory Tracking with Learned Dynamics: Joint Koopman-based Learning of System Models and Function Dictionaries

Nonlinear dynamical effects are crucial to the operation of many agile r...
09/02/2020

Adaptive CVaR Optimization for Dynamical Systems with Path Space Stochastic Search

We present a general framework for optimizing the Conditional Value-at-R...
03/09/2021

Risk-Averse RRT* Planning with Nonlinear Steering and Tracking Controllers for Nonlinear Robotic Systems Under Uncertainty

We propose a two-phase risk-averse architecture for controlling stochast...
11/15/2019

Safe Interactive Model-Based Learning

Control applications present hard operational constraints. A violation o...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.