An open-ended learning architecture to face the REAL 2020 simulated robot competition

by   Emilio Cartoni, et al.

Open-ended learning is a core research field of machine learning and robotics aiming to build learning machines and robots able to autonomously acquire knowledge and skills and to reuse them to solve novel tasks. The multiple challenges posed by open-ended learning have been operationalized in the robotic competition REAL 2020. This requires a simulated camera-arm-gripper robot to (a) autonomously learn to interact with objects during an intrinsic phase where it can learn how to move objects and then (b) during an extrinsic phase, to re-use the acquired knowledge to accomplish externally given goals requiring the robot to move objects to specific locations unknown during the intrinsic phase. Here we present a 'baseline architecture' for solving the challenge, provided as baseline model for REAL 2020. Few models have all the functionalities needed to solve the REAL 2020 benchmark and none has been tested with it yet. The architecture we propose is formed by three components: (1) Abstractor: abstracting sensory input to learn relevant control variables from images; (2) Explorer: generating experience to learn goals and actions; (3) Planner: formulating and executing action plans to accomplish the externally provided goals. The architecture represents the first model to solve the simpler REAL 2020 'Round 1' allowing the use of a simple parameterised push action. On Round 2, the architecture was used with a more general action (sequence of joints positions) achieving again higher than chance level performance. The baseline software is well documented and available for download and use at



There are no comments yet.


page 1

page 2

page 3

page 4


Autonomous learning of multiple, context-dependent tasks

When facing the problem of autonomously learning multiple tasks with rei...

Grasp and Motion Planning for Dexterous Manipulation for the Real Robot Challenge

This report describes our winning submission to the Real Robot Challenge...

Improvisation through Physical Understanding: Using Novel Objects as Tools with Visual Foresight

Machine learning techniques have enabled robots to learn narrow, yet com...

Composable Action-Conditioned Predictors: Flexible Off-Policy Learning for Robot Navigation

A general-purpose intelligent robot must be able to learn autonomously a...

Learning and Reasoning with Action-Related Places for Robust Mobile Manipulation

We propose the concept of Action-Related Place (ARPlace) as a powerful a...

DeepSym: Deep Symbol Generation and Rule Learning from Unsupervised Continuous Robot Interaction for Planning

Autonomous discovery of discrete symbols and rules from continuous inter...

LAAIR: A Layered Architecture for Autonomous Interactive Robots

When developing general purpose robots, the overarching software archite...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.