Real-time Sampling-based Model Predictive Control based on Reverse Kullback-Leibler Divergence and Its Adaptive Acceleration

12/08/2022
by   Taisuke Kobayashi, et al.
0

Sampling-based model predictive control (MPC) can be applied to versatile robotic systems. However, the real-time control with it is a big challenge due to its unstable updates and poor convergence. This paper tackles this challenge with a novel derivation from reverse Kullback-Leibler divergence, which has a mode-seeking behavior and is likely to find one of the sub-optimal solutions early. With this derivation, a weighted maximum likelihood estimation with positive/negative weights is obtained, solving by mirror descent (MD) algorithm. While the negative weights eliminate unnecessary actions, that requires to develop a practical implementation that avoids the interference with positive/negative updates based on rejection sampling. In addition, although the convergence of MD can be accelerated with Nesterov's acceleration method, it is modified for the proposed MPC with a heuristic of a step size adaptive to the noise estimated in update amounts. In the real-time simulations, the proposed method can solve more tasks statistically than the conventional method and accomplish more complex tasks only with a CPU due to the improved acceleration. In addition, its applicability is also demonstrated in a variable impedance control of a force-driven mobile robot. https://youtu.be/D8bFMzct1XM

READ FULL TEXT

page 1

page 7

research
01/03/2022

Adaptive Model Predictive Control of Wheeled Mobile Robots

In this paper, a control algorithm for guiding a two wheeled mobile robo...
research
05/17/2022

Dual-mode robust MPC for the tracking control of non-holonomoic mobile robots

In this paper, a novel dual-mode robust model predictive control (MPC) a...
research
04/15/2020

Quadrupedal Locomotion via Event-Based Predictive Control and QP-Based Virtual Constraints

This paper aims to develop a hierarchical nonlinear control algorithm, b...
research
08/16/2023

Differentiable Robust Model Predictive Control

Deterministic model predictive control (MPC), while powerful, is often i...
research
09/12/2023

ChatMPC: Natural Language based MPC Personalization

We address the personalization of control systems, which is an attempt t...
research
12/01/2022

Predictive Sampling: Real-time Behaviour Synthesis with MuJoCo

We introduce MuJoCo MPC (MJPC), an open-source, interactive application ...
research
09/14/2023

A Unified Perspective on Multiple Shooting In Differential Dynamic Programming

Differential Dynamic Programming (DDP) is an efficient computational too...

Please sign up or login with your details

Forgot password? Click here to reset