Autonomous Goal Exploration using Learned Goal Spaces for Visuomotor Skill Acquisition in Robots

06/10/2019
by   Adrien Laversanne-Finot, et al.
0

The automatic and efficient discovery of skills, without supervision, for long-living autonomous agents, remains a challenge of Artificial Intelligence. Intrinsically Motivated Goal Exploration Processes give learning agents a human-inspired mechanism to sequentially select goals to achieve. This approach gives a new perspective on the lifelong learning problem, with promising results on both simulated and real-world experiments. Until recently, those algorithms were restricted to domains with experimenter-knowledge, since the Goal Space used by the agents was built on engineered feature extractors. The recent advances of deep representation learning, enables new ways of designing those feature extractors, using directly the agent experience. Recent work has shown the potential of those methods on simple yet challenging simulated domains. In this paper, we present recent results showing the applicability of those principles on a real-world robotic setup, where a 6-joint robotic arm learns to manipulate a ball inside an arena, by choosing goals in a space learned from its past experience.

READ FULL TEXT

page 4

page 13

research
03/02/2018

Unsupervised Learning of Goal Spaces for Intrinsically Motivated Goal Exploration

Intrinsically motivated goal exploration algorithms enable machines to d...
research
07/04/2018

Curiosity Driven Exploration of Learned Disentangled Goal Spaces

Intrinsically motivated goal exploration processes enable agents to auto...
research
05/19/2018

Autonomous discovery of the goal space to learn a parameterized skill

A parameterized skill is a mapping from multiple goals/task parameters t...
research
08/19/2019

Intrinsically Motivated Exploration for Automated Discovery of Patterns in Morphogenetic Systems

Exploration is a cornerstone both for machine learning algorithms and fo...
research
04/11/2022

Learning Object-Centered Autotelic Behaviors with Graph Neural Networks

Although humans live in an open-ended world and endlessly face new chall...
research
05/25/2021

Towards Teachable Autonomous Agents

Autonomous discovery and direct instruction are two extreme sources of l...
research
01/22/2020

GLIB: Exploration via Goal-Literal Babbling for Lifted Operator Learning

We address the problem of efficient exploration for learning lifted oper...

Please sign up or login with your details

Forgot password? Click here to reset