Tracking Partially-Occluded Deformable Objects while Enforcing Geometric Constraints

11/01/2020
by   Yixuan Wang, et al.
0

In order to manipulate a deformable object, such as rope or cloth, in unstructured environments, robots need a way to estimate its current shape. However, tracking the shape of a deformable object can be challenging because of the object's high flexibility, (self-)occlusion, and interaction with obstacles. Building a high-fidelity physics simulation to aid in tracking is difficult for novel environments. Instead we focus on tracking the object based on RGBD images and geometric motion estimates and obstacles. Our key contributions over previous work in this vein are: 1) A better way to handle severe occlusion by using a motion model to regularize the tracking estimate; and 2) The formulation of convex geometric constraints, which allow us to prevent self-intersection and penetration into known obstacles via a post-processing step. These contributions allow us to outperform previous methods by a large margin in terms of accuracy in scenarios with severe occlusion and obstacles.

READ FULL TEXT

page 1

page 5

page 6

research
01/04/2021

Occlusion-robust Deformable Object Tracking without Physics Simulation

Estimating the state of a deformable object is crucial for robotic manip...
research
01/27/2020

Manipulating Deformable Objects by Interleaving Prediction, Planning, and Control

We present a framework for deformable object manipulation that interleav...
research
02/27/2023

DLOFTBs – Fast Tracking of Deformable Linear Objects with B-splines

While the manipulation of rigid objects is an extensively explored resea...
research
12/09/2020

Constraining Dense Hand Surface Tracking with Elasticity

Many of the actions that we take with our hands involve self-contact and...
research
09/05/2022

Lattice-based shape tracking and servoing of elastic objects

In this paper, we propose a general unified tracking-servoing approach f...
research
05/13/2019

Occlusion-Robust MVO: Multimotion Estimation Through Occlusion Via Motion Closure

Visual motion estimation is an integral and well-studied challenge in au...
research
04/01/2021

Fusing RGBD Tracking and Segmentation Tree Sampling for Multi-Hypothesis Volumetric Segmentation

Despite rapid progress in scene segmentation in recent years, 3D segment...

Please sign up or login with your details

Forgot password? Click here to reset