Vision-based Manipulation of Deformable and Rigid Objects Using Subspace Projections of 2D Contours

06/16/2020
by   Jihong Zhu, et al.
0

This paper proposes a unified vision-based manipulation framework using image contours of deformable/rigid objects. Instead of using human-defined cues, the robot automatically learns the features from processed vision data. Our method simultaneously generates—from the same data—both, visual features and the interaction matrix that relates them to the robot control inputs. Extraction of the feature vector and control commands is done online and adaptively, with little data for initialization. The method allows the robot to manipulate an object without knowing whether it is rigid or deformable. To validate our approach, we conduct numerical simulations and experiments with both deformable and rigid objects.

READ FULL TEXT

page 9

page 11

research
05/22/2023

DeRi-Bot: Learning to Collaboratively Manipulate Rigid Objects via Deformable Objects

Recent research efforts have yielded significant advancements in manipul...
research
06/04/2021

Contour Moments Based Manipulation of Composite Rigid-Deformable Objects with Finite Time Model Estimation and Shape/Position Control

The robotic manipulation of composite rigid-deformable objects (i.e. tho...
research
05/19/2021

Localization and Tracking of User-Defined Points on Deformable Objects for Robotic Manipulation

This paper introduces an efficient procedure to localize user-defined po...
research
05/19/2014

Use of Computer Vision to Detect Tangles in Tangled Objects

Untangling of structures like ropes and wires by autonomous robots can b...
research
08/02/2017

An Energy Minimization Approach to 3D Non-Rigid Deformable Surface Estimation Using RGBD Data

We propose an algorithm that uses energy mini- mization to estimate the ...
research
07/19/2023

Contact-aware Shaping and Maintenance of Deformable Linear Objects With Fixtures

Studying the manipulation of deformable linear objects has significant p...
research
02/27/2018

Cloth Manipulation Using Random Forest-Based Controller Parametrization

We present a novel approach for robust manipulation of high-DOF deformab...

Please sign up or login with your details

Forgot password? Click here to reset