Learning Quasi-Static 3D Models of Markerless Deformable Linear Objects for Bimanual Robotic Manipulation

09/14/2023
by   Piotr Kicki, et al.
0

The robotic manipulation of Deformable Linear Objects (DLOs) is a vital and challenging task that is important in many practical applications. Classical model-based approaches to this problem require an accurate model to capture how robot motions affect the deformation of the DLO. Nowadays, data-driven models offer the best tradeoff between quality and computation time. This paper analyzes several learning-based 3D models of the DLO and proposes a new one based on the Transformer architecture that achieves superior accuracy, even on the DLOs of different lengths, thanks to the proposed scaling method. Moreover, we introduce a data augmentation technique, which improves the prediction performance of almost all considered DLO data-driven models. Thanks to this technique, even a simple Multilayer Perceptron (MLP) achieves close to state-of-the-art performance while being significantly faster to evaluate. In the experiments, we compare the performance of the learning-based 3D models of the DLO on several challenging datasets quantitatively and demonstrate their applicability in the task of shaping a DLO.

READ FULL TEXT

page 1

page 8

research
02/20/2022

Differentiable Robotic Manipulation of Deformable Rope-like Objects Using Compliant Position-based Dynamics

Robot manipulation of rope-like objects is an interesting problem that h...
research
02/28/2019

Static Stability of Robotic Fabric Strip Folding

Planning accurate manipulation for deformable objects requires predictio...
research
05/11/2019

Learning Robotic Manipulation through Visual Planning and Acting

Planning for robotic manipulation requires reasoning about the changes a...
research
03/05/2023

Sim2Real Physically Informed Neural Controllers for Robotic Deployment of Deformable Linear Objects

Deformable linear objects, such as rods, cables, and ropes, play importa...
research
05/12/2019

Structure from Articulated Motion: An Accurate and Stable Monocular 3D Reconstruction Approach without Training Data

Recovery of articulated 3D structure from 2D observations is a challengi...
research
07/14/2021

Deformable Elasto-Plastic Object Shaping using an Elastic Hand and Model-Based Reinforcement Learning

Deformable solid objects such as clay or dough are prevalent in industri...
research
01/05/2023

Deep Learning of Force Manifolds from the Simulated Physics of Robotic Paper Folding

Robotic manipulation of slender objects is challenging, especially when ...

Please sign up or login with your details

Forgot password? Click here to reset