Real-Robot Deep Reinforcement Learning: Improving Trajectory Tracking of Flexible-Joint Manipulator with Reference Correction

03/14/2022
by   Dmytro Pavlichenko, et al.
0

Flexible-joint manipulators are governed by complex nonlinear dynamics, defining a challenging control problem. In this work, we propose an approach to learn an outer-loop joint trajectory tracking controller with deep reinforcement learning. The controller represented by a stochastic policy is learned in under two hours directly on the real robot. This is achieved through bounded reference correction actions and use of a model-free off-policy learning method. In addition, an informed policy initialization is proposed, where the agent is pre-trained in a learned simulation. We test our approach on the 7 DOF manipulator of a Baxter robot. We demonstrate that the proposed method is capable of consistent learning across multiple runs when applied directly on the real robot. Our method yields a policy which significantly improves the trajectory tracking accuracy in comparison to the vendor-provided controller, generalizing to an unseen payload.

READ FULL TEXT
research
07/07/2022

Retro-RL: Reinforcing Nominal Controller With Deep Reinforcement Learning for Tilting-Rotor Drones

Studies that broaden drone applications into complex tasks require a sta...
research
10/29/2019

Feedback Linearization for Unknown Systems via Reinforcement Learning

We present a novel approach to control design for nonlinear systems, whi...
research
11/12/2020

Joint Space Control via Deep Reinforcement Learning

The dominant way to control a robot manipulator uses hand-crafted differ...
research
04/01/2023

Tracker: Model-based Reinforcement Learning for Tracking Control of Human Finger Attached with Thin McKibben Muscles

To adopt the soft hand exoskeleton to support activities of daily living...
research
03/13/2019

Trajectory Optimization for Unknown Constrained Systems using Reinforcement Learning

In this paper, we propose a reinforcement learning-based algorithm for t...
research
08/24/2018

Trajectory Tracking Control of a Flexible Spine Robot, With and Without a Reference Input

The Underactuated Lightweight Tensegrity Robotic Assistive Spine (ULTRA ...
research
11/13/2020

Robust Quadruped Jumping via Deep Reinforcement Learning

In this paper we consider a general task of jumping varying distances an...

Please sign up or login with your details

Forgot password? Click here to reset