Graph-Transporter: A Graph-based Learning Method for Goal-Conditioned Deformable Object Rearranging Task

02/21/2023
by   Yuhong Deng, et al.
0

Rearranging deformable objects is a long-standing challenge in robotic manipulation for the high dimensionality of configuration space and the complex dynamics of deformable objects. We present a novel framework, Graph-Transporter, for goal-conditioned deformable object rearranging tasks. To tackle the challenge of complex configuration space and dynamics, we represent the configuration space of a deformable object with a graph structure and the graph features are encoded by a graph convolution network. Our framework adopts an architecture based on Fully Convolutional Network (FCN) to output pixel-wise pick-and-place actions from only visual input. Extensive experiments have been conducted to validate the effectiveness of the graph representation of deformable object configuration. The experimental results also demonstrate that our framework is effective and general in handling goal-conditioned deformable object rearranging tasks.

READ FULL TEXT

page 1

page 3

page 4

page 6

research
03/02/2023

Learning Language-Conditioned Deformable Object Manipulation with Graph Dynamics

Vision-based deformable object manipulation is a challenging problem in ...
research
12/06/2020

Learning to Rearrange Deformable Cables, Fabrics, and Bags with Goal-Conditioned Transporter Networks

Rearranging and manipulating deformable objects such as cables, fabrics,...
research
02/21/2023

Deep Reinforcement Learning Based on Local GNN for Goal-conditioned Deformable Object Rearranging

Object rearranging is one of the most common deformable manipulation tas...
research
03/26/2021

Deformable Linear Object Prediction Using Locally Linear Latent Dynamics

We propose a framework for deformable linear object prediction. Predicti...
research
04/25/2021

Learning Latent Graph Dynamics for Deformable Object Manipulation

Manipulating deformable objects, such as cloth and ropes, is a long-stan...
research
09/26/2019

Realtime Simulation of Thin-Shell Deformable Materials using CNN-Based Mesh Embedding

We address the problem of accelerating thin-shell deformable object simu...
research
08/26/2020

Self-Supervised Goal-Conditioned Pick and Place

Robots have the capability to collect large amounts of data autonomously...

Please sign up or login with your details

Forgot password? Click here to reset