Task-grasping from human demonstration

03/01/2022
by   Daichi Saito, et al.
0

A challenge in robot grasping is to achieve task-grasping which is to select a grasp that is advantageous to the success of tasks before and after grasps. One of the frameworks to address this difficulty is Learning-from-Observation (LfO), which obtains various hints from human demonstrations. This paper solves three issues in the grasping skills in the LfO framework: 1) how to functionally mimic human-demonstrated grasps to robots with limited grasp capability, 2) how to coordinate grasp skills with reaching body mimicking, 3) how to robustly perform grasps under object pose and shape uncertainty. A deep reinforcement learning using contact-web based rewards and domain randomization of approach directions is proposed to achieve such robust mimicked grasping skills. Experiment results show that the trained grasping skills can be applied in an LfO system and executed on a real robot. In addition, it is shown that the trained skill is robust to errors in the object pose and to the uncertainty of the object shape and can be combined with various reach-coordination.

READ FULL TEXT

page 1

page 2

page 5

research
09/19/2018

Leveraging Contact Forces for Learning to Grasp

Grasping objects under uncertainty remains an open problem in robotics r...
research
04/07/2019

ContactGrasp: Functional Multi-finger Grasp Synthesis from Contact

Grasping and manipulating objects is an important human skill. Since mos...
research
07/06/2022

NeuralGrasps: Learning Implicit Representations for Grasps of Multiple Robotic Hands

We introduce a neural implicit representation for grasps of objects from...
research
12/12/2022

Where To Start? Transferring Simple Skills to Complex Environments

Robot learning provides a number of ways to teach robots simple skills, ...
research
07/10/2023

Learning Fine Pinch-Grasp Skills using Tactile Sensing from Real Demonstration Data

This work develops a data-efficient learning from demonstration framewor...
research
02/11/2020

Reaching, Grasping and Re-grasping: Learning Fine Coordinated Motor Skills

The ability to adapt to uncertainties, recover from failures, and sensor...
research
03/31/2023

Generalized Anthropomorphic Functional Grasping with Minimal Demonstrations

This article investigates the challenge of achieving functional tool-use...

Please sign up or login with your details

Forgot password? Click here to reset