DexPBT: Scaling up Dexterous Manipulation for Hand-Arm Systems with Population Based Training

05/20/2023
by   Aleksei Petrenko, et al.
0

In this work, we propose algorithms and methods that enable learning dexterous object manipulation using simulated one- or two-armed robots equipped with multi-fingered hand end-effectors. Using a parallel GPU-accelerated physics simulator (Isaac Gym), we implement challenging tasks for these robots, including regrasping, grasp-and-throw, and object reorientation. To solve these problems we introduce a decentralized Population-Based Training (PBT) algorithm that allows us to massively amplify the exploration capabilities of deep reinforcement learning. We find that this method significantly outperforms regular end-to-end learning and is able to discover robust control policies in challenging tasks. Video demonstrations of learned behaviors and the code can be found at https://sites.google.com/view/dexpbt

READ FULL TEXT

page 1

page 2

page 3

research
06/06/2023

A Grasp Pose is All You Need: Learning Multi-fingered Grasping with Deep Reinforcement Learning from Vision and Touch

Multi-fingered robotic hands could enable robots to perform sophisticate...
research
09/16/2021

Decentralized Control of Quadrotor Swarms with End-to-end Deep Reinforcement Learning

We demonstrate the possibility of learning drone swarm controllers that ...
research
10/14/2018

Dexterous Manipulation with Deep Reinforcement Learning: Efficient, General, and Low-Cost

Dexterous multi-fingered robotic hands can perform a wide range of manip...
research
08/01/2018

Learning Dexterous In-Hand Manipulation

We use reinforcement learning (RL) to learn dexterous in-hand manipulati...
research
08/24/2021

Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learning

Isaac Gym offers a high performance learning platform to train policies ...
research
03/06/2023

Sampling-based Exploration for Reinforcement Learning of Dexterous Manipulation

In this paper, we present a novel method for achieving dexterous manipul...
research
11/28/2022

Collective Intelligence for Object Manipulation with Mobile Robots

While natural systems often present collective intelligence that allows ...

Please sign up or login with your details

Forgot password? Click here to reset