Sparse-Dense Motion Modelling and Tracking for Manipulation without Prior Object Models

04/25/2022
by   Christian Rauch, et al.
0

This work presents an approach for modelling and tracking previously unseen objects for robotic grasping tasks. Using the motion of objects in a scene, our approach segments rigid entities from the scene and continuously tracks them to create a dense and sparse model of the object and the environment. While the dense tracking enables interaction with these models, the sparse tracking makes this robust against fast movements and allows to redetect already modelled objects. The evaluation on a dual-arm grasping task demonstrates that our approach 1) enables a robot to detect new objects online without a prior model and to grasp these objects using only a simple parameterisable geometric representation, and 2) is much more robust compared to the state of the art methods.

READ FULL TEXT

page 5

page 7

page 8

research
03/09/2021

Deep 6-DoF Tracking of Unknown Objects for Reactive Grasping

Robotic manipulation of unknown objects is an important field of researc...
research
10/06/2009

Building upon Fast Multipole Methods to Detect and Model Organizations

Many models in natural and social sciences are comprised of sets of inte...
research
10/07/2022

Scene-level Tracking and Reconstruction without Object Priors

We present the first real-time system capable of tracking and reconstruc...
research
06/22/2018

Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulation

What is the right object representation for manipulation? We would like ...
research
02/05/2015

Learning Articulated Motions From Visual Demonstration

Many functional elements of human homes and workplaces consist of rigid ...
research
08/30/2023

RoboTAP: Tracking Arbitrary Points for Few-Shot Visual Imitation

For robots to be useful outside labs and specialized factories we need a...
research
11/29/2019

Learning Modular Representations for Long-Term Multi-Agent Motion Predictions

Context plays a significant role in the generation of motion for dynamic...

Please sign up or login with your details

Forgot password? Click here to reset