Omnipush: accurate, diverse, real-world dataset of pushing dynamics with RGB-D video

10/01/2019
by   Maria Bauza, et al.
7

Pushing is a fundamental robotic skill. Existing work has shown how to exploit models of pushing to achieve a variety of tasks, including grasping under uncertainty, in-hand manipulation and clearing clutter. Such models, however, are approximate, which limits their applicability. Learning-based methods can reason directly from raw sensory data with accuracy, and have the potential to generalize to a wider diversity of scenarios. However, developing and testing such methods requires rich-enough datasets. In this paper we introduce Omnipush, a dataset with high variety of planar pushing behavior. In particular, we provide 250 pushes for each of 250 objects, all recorded with RGB-D and a high precision tracking system. The objects are constructed so as to systematically explore key factors that affect pushing –the shape of the object and its mass distribution– which have not been broadly explored in previous datasets, and allow to study generalization in model learning. Omnipush includes a benchmark for meta-learning dynamic models, which requires algorithms that make good predictions and estimate their own uncertainty. We also provide an RGB video prediction benchmark and propose other relevant tasks that can be suited with this dataset. Data and code are available at <https://web.mit.edu/mcube/omnipush-dataset/>.

READ FULL TEXT

page 1

page 2

page 5

page 7

research
10/25/2019

Learning Task-Oriented Grasping from Human Activity Datasets

We propose to leverage a real-world, human activity RGB datasets to teac...
research
12/08/2019

6-DOF Grasping for Target-driven Object Manipulation in Clutter

Grasping in cluttered environments is a fundamental but challenging robo...
research
04/16/2019

Combining RGB and Points to Predict Grasping Region for Robotic Bin-Picking

This paper focuses on a robotic picking tasks in cluttered scenario. Bec...
research
04/15/2019

ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imaging

Grasping and manipulating objects is an important human skill. Since han...
research
06/17/2023

NBMOD: Find It and Grasp It in Noisy Background

Grasping objects is a fundamental yet important capability of robots, an...
research
03/24/2023

ARKitTrack: A New Diverse Dataset for Tracking Using Mobile RGB-D Data

Compared with traditional RGB-only visual tracking, few datasets have be...
research
07/02/2018

Introducing the Simulated Flying Shapes and Simulated Planar Manipulator Datasets

We release two artificial datasets, Simulated Flying Shapes and Simulate...

Please sign up or login with your details

Forgot password? Click here to reset