Learning Kinematic Descriptions using SPARE: Simulated and Physical ARticulated Extendable dataset

by   Abhishek Venkataraman, et al.

Next generation robots will need to understand intricate and articulated objects as they cooperate in human environments. To do so, these robots will need to move beyond their current abilities--- working with relatively simple objects in a task-indifferent manner--- toward more sophisticated abilities that dynamically estimate the properties of complex, articulated objects. To that end, we make two compelling contributions toward general articulated (physical) object understanding in this paper. First, we introduce a new dataset, SPARE: Simulated and Physical ARticulated Extendable dataset. SPARE is an extendable open-source dataset providing equivalent simulated and physical instances of articulated objects (kinematic chains), providing the greater research community with a training and evaluation tool for methods generating kinematic descriptions of articulated objects. To the best of our knowledge, this is the first joint visual and physical (3D-printable) dataset for the Vision community. Second, we present a deep neural network that can predit the number of links and the length of the links of an articulated object. These new ideas outperform classical approaches to understanding kinematic chains, such tracking-based methods, which fail in the case of occlusion and do not leverage multiple views when available.


page 2

page 4

page 5

page 6


A Multi-body Tracking Framework – From Rigid Objects to Kinematic Structures

Kinematic structures are very common in the real world. They range from ...

Learning Articulated Motion Models from Visual and Lingual Signals

In order for robots to operate effectively in homes and workplaces, they...

Learning Extended Body Schemas from Visual Keypoints for Object Manipulation

Humans have impressive generalization capabilities when it comes to mani...

Finding Fallen Objects Via Asynchronous Audio-Visual Integration

The way an object looks and sounds provide complementary reflections of ...

Learning to Infer Kinematic Hierarchies for Novel Object Instances

Manipulating an articulated object requires perceiving itskinematic hier...

Incorporating Kinematic Wave Theory into a Deep Learning Method for High-Resolution Traffic Speed Estimation

We propose a kinematic wave based Deep Convolutional Neural Network (Dee...

Please sign up or login with your details

Forgot password? Click here to reset