Model-Driven Feed-Forward Prediction for Manipulation of Deformable Objects

07/15/2016
by   Yinxiao Li, et al.
0

Robotic manipulation of deformable objects is a difficult problem especially because of the complexity of the many different ways an object can deform. Searching such a high dimensional state space makes it difficult to recognize, track, and manipulate deformable objects. In this paper, we introduce a predictive, model-driven approach to address this challenge, using a pre-computed, simulated database of deformable object models. Mesh models of common deformable garments are simulated with the garments picked up in multiple different poses under gravity, and stored in a database for fast and efficient retrieval. To validate this approach, we developed a comprehensive pipeline for manipulating clothing as in a typical laundry task. First, the database is used for category and pose estimation for a garment in an arbitrary position. A fully featured 3D model of the garment is constructed in real-time and volumetric features are then used to obtain the most similar model in the database to predict the object category and pose. Second, the database can significantly benefit the manipulation of deformable objects via non-rigid registration, providing accurate correspondences between the reconstructed object model and the database models. Third, the accurate model simulation can also be used to optimize the trajectories for manipulation of deformable objects, such as the folding of garments. Extensive experimental results are shown for the tasks above using a variety of different clothing.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 10

page 13

page 16

page 18

research
05/22/2023

DeRi-Bot: Learning to Collaboratively Manipulate Rigid Objects via Deformable Objects

Recent research efforts have yielded significant advancements in manipul...
research
12/09/2021

A Bayesian Treatment of Real-to-Sim for Deformable Object Manipulation

Deformable object manipulation remains a challenging task in robotics re...
research
05/19/2021

Localization and Tracking of User-Defined Points on Deformable Objects for Robotic Manipulation

This paper introduces an efficient procedure to localize user-defined po...
research
05/22/2018

Deformable Part Networks

In this paper we propose novel Deformable Part Networks (DPNs) to learn ...
research
03/04/2021

Graph-based Task-specific Prediction Models for Interactions between Deformable and Rigid Objects

Capturing scene dynamics and predicting the future scene state is challe...
research
11/23/2020

Sequential Topological Representations for Predictive Models of Deformable Objects

Deformable objects present a formidable challenge for robotic manipulati...
research
03/24/2023

SPONGE: Sequence Planning with Deformable-ON-Rigid Contact Prediction from Geometric Features

Planning robotic manipulation tasks, especially those that involve inter...

Please sign up or login with your details

Forgot password? Click here to reset