DeepAI AI Chat
Log In Sign Up

Improving the Robustness of Reinforcement Learning Policies with ℒ_1 Adaptive Control

12/03/2021
by   Y. Cheng, et al.
University of Illinois at Urbana-Champaign
0

A reinforcement learning (RL) control policy trained in a nominal environment could fail in a new/perturbed environment due to the existence of dynamic variations. For controlling systems with continuous state and action spaces, we propose an add-on approach to robustifying a pre-trained RLpolicy by augmenting it with an ℒ_1 adaptive controller (ℒ_1AC). Leveraging the capability of an ℒ_1AC for fast estimation and active compensation of dynamic variations, the proposed approach can improve the robustness of an RL policy which is trained either in a simulator or in the real world without consideration of a broad class of dynamic variations. Numerical and real-world experiments empirically demonstrate the efficacy of the proposed approach in robustifying RL policies trained using both model-free and model-based methods. A video for the experiments on a real Pendubot setup is availableathttps://youtu.be/xgOB9vpyUgE.

READ FULL TEXT

page 1

page 6

page 7

06/04/2021

Robustifying Reinforcement Learning Policies with ℒ_1 Adaptive Control

A reinforcement learning (RL) policy trained in a nominal environment co...
11/20/2020

MRAC-RL: A Framework for On-Line Policy Adaptation Under Parametric Model Uncertainty

Reinforcement learning (RL) algorithms have been successfully used to de...
10/15/2021

GrowSpace: Learning How to Shape Plants

Plants are dynamic systems that are integral to our existence and surviv...
03/24/2020

Learning to Play Soccer by Reinforcement and Applying Sim-to-Real to Compete in the Real World

This work presents an application of Reinforcement Learning (RL) for the...
10/06/2022

Deep Inventory Management

We present a Deep Reinforcement Learning approach to solving a periodic ...
03/13/2021

RL-Controller: a reinforcement learning framework for active structural control

To maintain structural integrity and functionality during the designed l...
01/31/2023

Few-Shot Image-to-Semantics Translation for Policy Transfer in Reinforcement Learning

We investigate policy transfer using image-to-semantics translation to m...