DexYCB: A Benchmark for Capturing Hand Grasping of Objects

04/09/2021
by   Yu-Wei Chao, et al.
Nvidia
5

We introduce DexYCB, a new dataset for capturing hand grasping of objects. We first compare DexYCB with a related one through cross-dataset evaluation. We then present a thorough benchmark of state-of-the-art approaches on three relevant tasks: 2D object and keypoint detection, 6D object pose estimation, and 3D hand pose estimation. Finally, we evaluate a new robotics-relevant task: generating safe robot grasps in human-to-robot object handover. Dataset and code are available at https://dex-ycb.github.io.

READ FULL TEXT

page 1

page 12

page 17

page 18

page 19

page 20

page 21

page 22

05/19/2022

HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handovers

We introduce a new simulation benchmark "HandoverSim" for human-to-robot...
06/19/2014

R-CNNs for Pose Estimation and Action Detection

We present convolutional neural networks for the tasks of keypoint (pose...
05/14/2019

Scratchy: A Lightweight Modular Autonomous Robot for Robotic Competitions

We present Scratchy---a modular, lightweight robot built for low budget ...
11/16/2021

IKEA Object State Dataset: A 6DoF object pose estimation dataset and benchmark for multi-state assembly objects

Utilizing 6DoF(Degrees of Freedom) pose information of an object and its...
10/17/2018

Video Segmentation using Teacher-Student Adaptation in a Human Robot Interaction (HRI) Setting

Video segmentation is a challenging task that has many applications in r...
08/02/2023

HANDAL: A Dataset of Real-World Manipulable Object Categories with Pose Annotations, Affordances, and Reconstructions

We present the HANDAL dataset for category-level object pose estimation ...
01/19/2022

Semi-automatic 3D Object Keypoint Annotation and Detection for the Masses

Creating computer vision datasets requires careful planning and lots of ...

Code Repositories

dex-ycb-toolkit

A Python package that provides evaluation and visualization tools for the DexYCB dataset


view repo

Please sign up or login with your details

Forgot password? Click here to reset