Learning Score-based Grasping Primitive for Human-assisting Dexterous Grasping

09/12/2023
by   Tianhao Wu, et al.
0

The use of anthropomorphic robotic hands for assisting individuals in situations where human hands may be unavailable or unsuitable has gained significant importance. In this paper, we propose a novel task called human-assisting dexterous grasping that aims to train a policy for controlling a robotic hand's fingers to assist users in grasping objects. Unlike conventional dexterous grasping, this task presents a more complex challenge as the policy needs to adapt to diverse user intentions, in addition to the object's geometry. We address this challenge by proposing an approach consisting of two sub-modules: a hand-object-conditional grasping primitive called Grasping Gradient Field (GraspGF), and a history-conditional residual policy. GraspGF learns `how' to grasp by estimating the gradient from a success grasping example set, while the residual policy determines `when' and at what speed the grasping action should be executed based on the trajectory history. Experimental results demonstrate the superiority of our proposed method compared to baselines, highlighting the user-awareness and practicality in real-world applications. The codes and demonstrations can be viewed at "https://sites.google.com/view/graspgf".

READ FULL TEXT

page 1

page 7

page 8

page 9

page 16

research
03/17/2023

DexRepNet: Learning Dexterous Robotic Grasping Network with Geometric and Spatial Hand-Object Representations

Robotic dexterous grasping is a challenging problem due to the high degr...
research
04/06/2021

Attribute-Based Robotic Grasping with One-Grasp Adaptation

Robotic grasping is one of the most fundamental robotic manipulation tas...
research
10/24/2022

Learning Robust Real-World Dexterous Grasping Policies via Implicit Shape Augmentation

Dexterous robotic hands have the capability to interact with a wide vari...
research
01/04/2022

Primitive Shape Recognition for Object Grasping

Shape informs how an object should be grasped, both in terms of where an...
research
11/20/2022

Efficient Representations of Object Geometry for Reinforcement Learning of Interactive Grasping Policies

Grasping objects of different shapes and sizes - a foundational, effortl...
research
05/30/2022

Multi-Object Grasping – Types and Taxonomy

This paper proposes 12 multi-object grasps (MOGs) types from a human and...
research
06/19/2021

Grasping Benchmarks: Normalizing for Object Size & Approximating Hand Workspaces

The varied landscape of robotic hand designs makes it difficult to set a...

Please sign up or login with your details

Forgot password? Click here to reset