Learning Model Predictive Controllers with Real-Time Attention for Real-World Navigation

09/22/2022
by   Xuesu Xiao, et al.
16

Despite decades of research, existing navigation systems still face real-world challenges when deployed in the wild, e.g., in cluttered home environments or in human-occupied public spaces. To address this, we present a new class of implicit control policies combining the benefits of imitation learning with the robust handling of system constraints from Model Predictive Control (MPC). Our approach, called Performer-MPC, uses a learned cost function parameterized by vision context embeddings provided by Performers – a low-rank implicit-attention Transformer. We jointly train the cost function and construct the controller relying on it, effectively solving end-to-end the corresponding bi-level optimization problem. We show that the resulting policy improves standard MPC performance by leveraging a few expert demonstrations of the desired navigation behavior in different challenging real-world scenarios. Compared with a standard MPC policy, Performer-MPC achieves >40 reached in cluttered environments and >65 navigating around humans.

READ FULL TEXT

page 1

page 5

page 7

page 18

research
10/31/2018

Differentiable MPC for End-to-end Planning and Control

We present foundations for using Model Predictive Control (MPC) as a dif...
research
05/30/2023

GAN-MPC: Training Model Predictive Controllers with Parameterized Cost Functions using Demonstrations from Non-identical Experts

Model predictive control (MPC) is a popular approach for trajectory opti...
research
04/17/2020

Approximate Inverse Reinforcement Learning from Vision-based Imitation Learning

In this work, we present a method for obtaining an implicit objective fu...
research
06/24/2022

MPC-based Imitation Learning for Safe and Human-like Autonomous Driving

To ensure user acceptance of autonomous vehicles (AVs), control systems ...
research
09/11/2019

MPC-Net: A First Principles Guided Policy Search

We present an Imitation Learning approach for the control of dynamical s...
research
11/05/2021

Learning Model Predictive Controllers for Real-Time Ride-Hailing Vehicle Relocation and Pricing Decisions

Large-scale ride-hailing systems often combine real-time routing at the ...
research
03/06/2020

Practical Reinforcement Learning For MPC: Learning from sparse objectives in under an hour on a real robot

Model Predictive Control (MPC) is a powerful control technique that hand...

Please sign up or login with your details

Forgot password? Click here to reset