Fast Reinforcement Learning with Incremental Gaussian Mixture Models

11/02/2020
by   Rafael Pinto, et al.
0

This work presents a novel algorithm that integrates a data-efficient function approximator with reinforcement learning in continuous state spaces. An online and incremental algorithm capable of learning from a single pass through data, called Incremental Gaussian Mixture Network (IGMN), was employed as a sample-efficient function approximator for the joint state and Q-values space, all in a single model, resulting in a concise and data-efficient algorithm, i.e., a reinforcement learning algorithm that learns from very few interactions with the environment. Results are analyzed to explain the properties of the obtained algorithm, and it is observed that the use of the IGMN function approximator brings some important advantages to reinforcement learning in relation to conventional neural networks trained by gradient descent methods.

READ FULL TEXT
research
07/13/2023

Cramer Type Distances for Learning Gaussian Mixture Models by Gradient Descent

The learning of Gaussian Mixture Models (also referred to simply as GMMs...
research
09/24/2020

A Rigorous Link Between Self-Organizing Maps and Gaussian Mixture Models

This work presents a mathematical treatment of the relation between Self...
research
05/18/2018

Two geometric input transformation methods for fast online reinforcement learning with neural nets

We apply neural nets with ReLU gates in online reinforcement learning. O...
research
06/19/2017

Dex: Incremental Learning for Complex Environments in Deep Reinforcement Learning

This paper introduces Dex, a reinforcement learning environment toolkit ...
research
07/28/2020

Lifelong Incremental Reinforcement Learning with Online Bayesian Inference

A central capability of a long-lived reinforcement learning (RL) agent i...
research
09/19/2023

Incremental Multimodal Surface Mapping via Self-Organizing Gaussian Mixture Models

This letter describes an incremental multimodal surface mapping methodol...
research
01/18/2016

Incremental Semiparametric Inverse Dynamics Learning

This paper presents a novel approach for incremental semiparametric inve...

Please sign up or login with your details

Forgot password? Click here to reset