Learning Contraction Policies from Offline Data

12/11/2021
by   Navid Rezazadeh, et al.
0

This paper proposes a data-driven method for learning convergent control policies from offline data using Contraction theory. Contraction theory enables constructing a policy that makes the closed-loop system trajectories inherently convergent towards a unique trajectory. At the technical level, identifying the contraction metric, which is the distance metric with respect to which a robot's trajectories exhibit contraction is often non-trivial. We propose to jointly learn the control policy and its corresponding contraction metric while enforcing contraction. To achieve this, we learn an implicit dynamics model of the robotic system from an offline data set consisting of the robot's state and input trajectories. Using this learned dynamics model, we propose a data augmentation algorithm for learning contraction policies. We randomly generate samples in the state-space and propagate them forward in time through the learned dynamics model to generate auxiliary sample trajectories. We then learn both the control policy and the contraction metric such that the distance between the trajectories from the offline data set and our generated auxiliary sample trajectories decreases over time. We evaluate the performance of our proposed framework on simulated robotic goal-reaching tasks and demonstrate that enforcing contraction results in faster convergence and greater robustness of the learned policy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/02/2021

A Theoretical Overview of Neural Contraction Metrics for Learning-based Control with Guaranteed Stability

This paper presents a theoretical overview of a Neural Contraction Metri...
research
10/01/2021

Contraction Theory for Nonlinear Stability Analysis and Learning-based Control: A Tutorial Overview

Contraction theory is an analytical tool to study differential dynamics ...
research
11/25/2020

Learning Certified Control using Contraction Metric

In this paper, we solve the problem of finding a certified control polic...
research
11/06/2020

Neural Stochastic Contraction Metrics for Robust Control and Estimation

We present neural stochastic contraction metrics, a new design framework...
research
12/15/2021

Guaranteed Contraction Control in the Presence of Imperfectly Learned Dynamics

This paper presents an approach for trajectory-centric learning control ...
research
12/31/2020

Universal Adaptive Control for Uncertain Nonlinear Systems

Precise motion planning and control require accurate models which are of...
research
07/10/2020

Neural Contraction Metrics for Robust Estimation and Control: A Convex Optimization Approach

This paper presents a new deep learning-based framework for robust nonli...

Please sign up or login with your details

Forgot password? Click here to reset