Continuous Value Iteration (CVI) Reinforcement Learning and Imaginary Experience Replay (IER) for learning multi-goal, continuous action and state space controllers

08/27/2019
by   Andreas Gerken, et al.
17

This paper presents a novel model-free Reinforcement Learning algorithm for learning behavior in continuous action, state, and goal spaces. The algorithm approximates optimal value functions using non-parametric estimators. It is able to efficiently learn to reach multiple arbitrary goals in deterministic and nondeterministic environments. To improve generalization in the goal space, we propose a novel sample augmentation technique. Using these methods, robots learn faster and overall better controllers. We benchmark the proposed algorithms using simulation and a real-world voltage controlled robot that learns to maneuver in a non-observable Cartesian task space.

READ FULL TEXT

page 1

page 5

research
11/28/2022

Continuous Episodic Control

Non-parametric episodic memory can be used to quickly latch onto high-re...
research
03/07/2006

Metric State Space Reinforcement Learning for a Vision-Capable Mobile Robot

We address the problem of autonomously learning controllers for vision-c...
research
04/26/2022

Learning Value Functions from Undirected State-only Experience

This paper tackles the problem of learning value functions from undirect...
research
03/20/2023

Deceptive Reinforcement Learning in Model-Free Domains

This paper investigates deceptive reinforcement learning for privacy pre...
research
10/11/2009

Higher coordination with less control - A result of information maximization in the sensorimotor loop

This work presents a novel learning method in the context of embodied ar...
research
05/26/2019

A Staged Approach to Evolving Real-world UAV Controllers

A testbed has recently been introduced that evolves controllers for arbi...
research
06/09/2023

Value function estimation using conditional diffusion models for control

A fairly reliable trend in deep reinforcement learning is that the perfo...

Please sign up or login with your details

Forgot password? Click here to reset