Proximal Reliability Optimization for Reinforcement Learning

06/03/2019
by   Narendra Patwardhan, et al.
0

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on absolute or deterministic reward as a metric for optimization process renders reinforcement learning highly susceptible to changes in problem dynamics. We introduce a novel framework that effectively quantizes the uncertainty of the design space and induces robustness in controllers by switching to a reliability-based optimization routine. The data efficiency of the method is maintained to match reward based optimization methods by employing a model-based approach. We prove the stability of learned neuro-controllers in both static and dynamic environments on classical reinforcement learning tasks such as Cart Pole balancing and Inverted Pendulum.

READ FULL TEXT

page 10

page 11

research
01/28/2022

Joint Differentiable Optimization and Verification for Certified Reinforcement Learning

In model-based reinforcement learning for safety-critical control system...
research
01/11/2022

Learning Robust Policies for Generalized Debris Capture with an Automated Tether-Net System

Tether-net launched from a chaser spacecraft provides a promising method...
research
05/15/2019

Reinforcement Learning for Robotics and Control with Active Uncertainty Reduction

Model-free reinforcement learning based methods such as Proximal Policy ...
research
12/11/2018

KF-LAX: Kronecker-factored curvature estimation for control variate optimization in reinforcement learning

A key challenge for gradient based optimization methods in model-free re...
research
05/10/2020

Reinforcement Learning based Design of Linear Fixed Structure Controllers

Reinforcement learning has been successfully applied to the problem of t...
research
09/12/2020

Extended Radial Basis Function Controller for Reinforcement Learning

There have been attempts in model-based reinforcement learning to exploi...
research
07/24/2019

Fairness in Reinforcement Learning

Decision support systems (e.g., for ecological conservation) and autonom...

Please sign up or login with your details

Forgot password? Click here to reset