Lattice-based shape tracking and servoing of elastic objects

In this paper, we propose a general unified tracking-servoing approach for controlling the shape of elastic deformable objects using robotic arms. Our approach works by forming a lattice around the object, binding the object to the lattice, and tracking and servoing the lattice instead of the object. This makes our approach have full 3D control over deformable objects of any general form (linear, thin-shell, volumetric). Furthermore, it decouples the runtime complexity of the approach from the objects' geometric complexity. Our approach is based on the As-Rigid-As-Possible (ARAP) deformation model. It requires no mechanical parameter of the object to be known and can drive the object toward desired shapes through large deformations. The inputs to our approach are the point cloud of the object's surface in its rest shape and the point cloud captured by a 3D camera in each frame. Overall, our approach is more broadly applicable than existing approaches. We validate the efficiency of our approach through numerous experiments with deformable objects of various shapes and materials (paper, rubber, plastic, foam). Experiment videos are available on the project website: https://sites.google.com/view/tracking-servoing-approach.

READ FULL TEXT

page 1

page 10

page 11

page 12

page 13

page 15

research
10/10/2021

Learning Visual Shape Control of Novel 3D Deformable Objects from Partial-View Point Clouds

If robots could reliably manipulate the shape of 3D deformable objects, ...
research
05/08/2023

DeformerNet: Learning Bimanual Manipulation of 3D Deformable Objects

Applications in fields ranging from home care to warehouse fulfillment t...
research
01/06/2021

Shape Control of Elastic Objects Based on Implicit Sensorimotor Models and Data-Driven Geometric Features

This paper proposes a general approach to design automatic controls to m...
research
07/13/2022

A Lattice Boltzmann dynamic-Immersed Boundary scheme for the transport of deformable inertial capsules in low-Re flows

In this work, a dynamic-Immersed–Boundary method combined with a BGK-Lat...
research
05/19/2021

Localization and Tracking of User-Defined Points on Deformable Objects for Robotic Manipulation

This paper introduces an efficient procedure to localize user-defined po...
research
11/01/2020

Tracking Partially-Occluded Deformable Objects while Enforcing Geometric Constraints

In order to manipulate a deformable object, such as rope or cloth, in un...
research
08/04/2017

Better Together: Joint Reasoning for Non-rigid 3D Reconstruction with Specularities and Shading

We demonstrate the use of shape-from-shading (SfS) to improve both the q...

Please sign up or login with your details

Forgot password? Click here to reset