E2R: a Hierarchical-Learning inspired Novelty-Search method to generate diverse repertoires of grasping trajectories

10/14/2022
by   Johann Huber, et al.
0

Robotics grasping refers to the task of making a robotic system pick an object by applying forces and torques on its surface. Despite the recent advances in data-driven approaches, grasping remains an unsolved problem. Most of the works on this task are relying on priors and heavy constraints to avoid the exploration problem. Novelty Search (NS) refers to evolutionary algorithms that replace selection of best performing individuals with selection of the most novel ones. Such methods have already shown promising results on hard exploration problems. In this work, we introduce a new NS-based method that can generate large datasets of grasping trajectories in a platform-agnostic manner. Inspired by the hierarchical learning paradigm, our method decouples approach and prehension to make the behavioral space smoother. Experiments conducted on 3 different robot-gripper setups and on several standard objects shows that our method outperforms state-of-the-art for generating diverse repertoire of grasping trajectories, getting a higher successful run ratio, as well as a better diversity for both approach and prehension. Some of the generated solutions have been successfully deployed on a real robot, showing the exploitability of the obtained repertoires.

READ FULL TEXT

page 1

page 6

research
08/10/2023

Quality Diversity under Sparse Reward and Sparse Interaction: Application to Grasping in Robotics

Quality-Diversity (QD) methods are algorithms that aim to generate a set...
research
05/17/2022

Automatic Acquisition of a Repertoire of Diverse Grasping Trajectories through Behavior Shaping and Novelty Search

Grasping a particular object may require a dedicated grasping movement t...
research
03/04/2022

GraspARL: Dynamic Grasping via Adversarial Reinforcement Learning

Grasping moving objects, such as goods on a belt or living animals, is a...
research
01/03/2019

From exploration to control: learning object manipulation skills through novelty search and local adaptation

Programming a robot to deal with open-ended tasks remains a challenge, i...
research
08/11/2020

Model-Based Quality-Diversity Search for Efficient Robot Learning

Despite recent progress in robot learning, it still remains a challenge ...
research
11/21/2022

FLEX: Full-Body Grasping Without Full-Body Grasps

Synthesizing 3D human avatars interacting realistically with a scene is ...
research
10/05/2016

Supervision via Competition: Robot Adversaries for Learning Tasks

There has been a recent paradigm shift in robotics to data-driven learni...

Please sign up or login with your details

Forgot password? Click here to reset