Reactive Human-to-Robot Handovers of Arbitrary Objects

11/17/2020
by   Wei Yang, et al.
2

Human-robot object handovers have been an actively studied area of robotics over the past decade; however, very few techniques and systems have addressed the challenge of handing over diverse objects with arbitrary appearance, size, shape, and rigidity. In this paper, we present a vision-based system that enables reactive human-to-robot handovers of unknown objects. Our approach combines closed-loop motion planning with real-time, temporally-consistent grasp generation to ensure reactivity and motion smoothness. Our system is robust to different object positions and orientations, and can grasp both rigid and non-rigid objects. We demonstrate the generalizability, usability, and robustness of our approach on a novel benchmark set of 26 diverse household objects, a user study with naive users (N=6) handing over a subset of 15 objects, and a systematic evaluation examining different ways of handing objects. More results and videos can be found at https://sites.google.com/nvidia.com/handovers-of-arbitrary-objects.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 5

page 6

03/12/2020

Human Grasp Classification for Reactive Human-to-Robot Handovers

Transfer of objects between humans and robots is a critical capability f...
03/31/2022

Model Predictive Control for Fluid Human-to-Robot Handovers

Human-robot handover is a fundamental yet challenging task in human-robo...
01/08/2021

Grasp and Motion Planning for Dexterous Manipulation for the Real Robot Challenge

This report describes our winning submission to the Real Robot Challenge...
12/05/2019

Reorienting Objects in 3D Space Using Pivoting

We consider the problem of reorienting a rigid object with arbitrary kno...
03/01/2022

Preemptive Motion Planning for Human-to-Robot Indirect Placement Handovers

As technology advances, the need for safe, efficient, and collaborative ...
06/28/2021

Real-time Human-Robot Collaborative Manipulations of Cylindrical and Cubic Objects via Geometric Primitives and Depth Information

Many objects commonly found in household and industrial environments are...
03/16/2022

GOMP-ST: Grasp Optimized Motion Planning for Suction Transport

Suction cup grasping is very common in industry, but moving too quickly ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.