Generalized Anthropomorphic Functional Grasping with Minimal Demonstrations

03/31/2023
by   Wei Wei, et al.
0

This article investigates the challenge of achieving functional tool-use grasping with high-DoF anthropomorphic hands, with the aim of enabling anthropomorphic hands to perform tasks that require human-like manipulation and tool-use. However, accomplishing human-like grasping in real robots present many challenges, including obtaining diverse functional grasps for a wide variety of objects, handling generalization ability for kinematically diverse robot hands and precisely completing object shapes from a single-view perception. To tackle these challenges, we propose a six-step grasp synthesis algorithm based on fine-grained contact modeling that generates physically plausible and human-like functional grasps for category-level objects with minimal human demonstrations. With the contact-based optimization and learned dense shape correspondence, the proposed algorithm is adaptable to various objects in same category and a board range of robot hand models. To further demonstrate the robustness of the framework, over 10K functional grasps are synthesized to train our neural network, named DexFG-Net, which generates diverse sets of human-like functional grasps based on the reconstructed object model produced by a shape completion module. The proposed framework is extensively validated in simulation and on a real robot platform. Simulation experiments demonstrate that our method outperforms baseline methods by a large margin in terms of grasp functionality and success rate. Real robot experiments show that our method achieved an overall success rate of 79% and 68% for tool-use grasp on 3-D printed and real test objects, respectively, using a 5-Finger Schunk Hand. The experimental results indicate a step towards human-like grasping with anthropomorphic hands.

READ FULL TEXT

page 2

page 4

page 11

page 13

page 14

page 16

page 17

page 18

research
04/07/2019

ContactGrasp: Functional Multi-finger Grasp Synthesis from Contact

Grasping and manipulating objects is an important human skill. Since mos...
research
11/14/2022

Multi-Finger Grasping Like Humans

Robots with multi-fingered grippers could perform advanced manipulation ...
research
03/01/2022

Task-grasping from human demonstration

A challenge in robot grasping is to achieve task-grasping which is to se...
research
03/02/2022

InsertionNet 2.0: Minimal Contact Multi-Step Insertion Using Multimodal Multiview Sensory Input

We address the problem of devising the means for a robot to rapidly and ...
research
07/31/2023

Deep Reinforcement Learning of Dexterous Pre-grasp Manipulation for Human-like Functional Categorical Grasping

Many objects such as tools and household items can be used only if grasp...
research
08/14/2023

Refining 6-DoF Grasps with Context-Specific Classifiers

In this work, we present GraspFlow, a refinement approach for generating...
research
11/12/2020

Fit2Form: 3D Generative Model for Robot Gripper Form Design

The 3D shape of a robot's end-effector plays a critical role in determin...

Please sign up or login with your details

Forgot password? Click here to reset