Towards Latent Space Based Manipulation of Elastic Rods using Autoencoder Models and Robust Centerline Extractions

01/19/2021
by   Jiaming Qi, et al.
0

The automatic shape control of deformable objects is a challenging (and currently hot) manipulation problem due to their high-dimensional geometric features and complex physical properties. In this study, a new methodology to manipulate elastic rods automatically into 2D desired shapes is presented. An efficient vision-based controller that uses a deep autoencoder network is designed to compute a compact representation of the object's infinite-dimensional shape. An online algorithm that approximates the sensorimotor mapping between the robot's configuration and the object's shape features is used to deal with the latter's (typically unknown) mechanical properties. The proposed approach computes the rod's centerline from raw visual data in real-time by introducing an adaptive algorithm on the basis of a self-organizing network. Its effectiveness is thoroughly validated with simulations and experiments.

READ FULL TEXT

page 15

page 16

page 17

page 19

research
08/16/2020

Adaptive Shape Servoing of Elastic Rods using Parameterized Regression Features and Auto-Tuning Motion Controls

In this paper, we present a new vision-based method to control the shape...
research
01/06/2021

Shape Control of Elastic Objects Based on Implicit Sensorimotor Models and Data-Driven Geometric Features

This paper proposes a general approach to design automatic controls to m...
research
05/20/2022

Model Predictive Manipulation of Compliant Objects with Multi-Objective Optimizer and Adversarial Network for Occlusion Compensation

The robotic manipulation of compliant objects is currently one of the mo...
research
06/04/2021

Contour Moments Based Manipulation of Composite Rigid-Deformable Objects with Finite Time Model Estimation and Shape/Position Control

The robotic manipulation of composite rigid-deformable objects (i.e. tho...
research
05/08/2023

DeformerNet: Learning Bimanual Manipulation of 3D Deformable Objects

Applications in fields ranging from home care to warehouse fulfillment t...
research
07/04/2022

Model-Free 3D Shape Control of Deformable Objects Using Novel Features Based on Modal Analysis

Shape control of deformable objects is a challenging and important robot...
research
05/11/2020

Learning to Slide Unknown Objects with Differentiable Physics Simulations

We propose a new technique for pushing an unknown object from an initial...

Please sign up or login with your details

Forgot password? Click here to reset