Efficient Representations of Object Geometry for Reinforcement Learning of Interactive Grasping Policies

11/20/2022
by   Malte Mosbach, et al.
0

Grasping objects of different shapes and sizes - a foundational, effortless skill for humans - remains a challenging task in robotics. Although model-based approaches can predict stable grasp configurations for known object models, they struggle to generalize to novel objects and often operate in a non-interactive open-loop manner. In this work, we present a reinforcement learning framework that learns the interactive grasping of various geometrically distinct real-world objects by continuously controlling an anthropomorphic robotic hand. We explore several explicit representations of object geometry as input to the policy. Moreover, we propose to inform the policy implicitly through signed distances and show that this is naturally suited to guide the search through a shaped reward component. Finally, we demonstrate that the proposed framework is able to learn even in more challenging conditions, such as targeted grasping from a cluttered bin. Necessary pre-grasping behaviors such as object reorientation and utilization of environmental constraints emerge in this case. Videos of learned interactive policies are available at https://maltemosbach.github. io/geometry_aware_grasping_policies.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 7

research
07/31/2023

Learning Generalizable Tool Use with Non-rigid Grasp-pose Registration

Tool use, a hallmark feature of human intelligence, remains a challengin...
research
09/03/2020

Dexterous Robotic Grasping with Object-Centric Visual Affordances

Dexterous robotic hands are appealing for their agility and human-like m...
research
03/04/2022

GraspARL: Dynamic Grasping via Adversarial Reinforcement Learning

Grasping moving objects, such as goods on a belt or living animals, is a...
research
06/28/2022

Dext-Gen: Dexterous Grasping in Sparse Reward Environments with Full Orientation Control

Reinforcement learning is a promising method for robotic grasping as it ...
research
09/17/2019

Split Deep Q-Learning for Robust Object Singulation

Extracting a known target object from a pile of other objects in a clutt...
research
09/12/2023

Learning Score-based Grasping Primitive for Human-assisting Dexterous Grasping

The use of anthropomorphic robotic hands for assisting individuals in si...
research
08/24/2017

Learning 6-DOF Grasping Interaction with Deep Geometry-aware 3D Representations

This paper focuses on the problem of learning 6-DOF grasping with a para...

Please sign up or login with your details

Forgot password? Click here to reset