Robot Vision Architecture for Autonomous Clothes Manipulation

10/18/2016
by   Li Sun, et al.
0

This paper presents a novel robot vision architecture for perceiving generic 3D clothes configurations. Our architecture is hierarchically structured, starting from low-level curvatures, across mid-level geometric shapes & topology descriptions; and finally approaching high-level semantic surface structure descriptions. We demonstrate our robot vision architecture in a customised dual-arm industrial robot with our self-designed, off-the-self stereo vision system, carrying out autonomous grasping and dual-arm flattening. It is worth noting that the proposed dual-arm flattening approach is unique among the state-of-the-art robot autonomous system, which is the major contribution of this paper. The experimental results show that the proposed dual-arm flattening using stereo vision system remarkably outperforms the single-arm flattening and widely-cited Kinect-based sensing system for dexterous manipulation tasks. In addition, the proposed grasping approach achieves satisfactory performance on grasping various kind of garments, verifying the capability of proposed visual perception architecture to be adapted to more than one clothing manipulation tasks.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 9

page 11

page 13

page 14

research
08/01/2021

Transformer-based deep imitation learning for dual-arm robot manipulation

Deep imitation learning is promising for solving dexterous manipulation ...
research
07/22/2017

Single-Shot Clothing Category Recognition in Free-Configurations with Application to Autonomous Clothes Sorting

This paper proposes a single-shot approach for recognising clothing cate...
research
09/23/2022

Towards Robust Autonomous Grasping with Reflexes Using High-Bandwidth Sensing and Actuation

Modern robotic manipulation systems fall short of human manipulation ski...
research
11/21/2018

Autonomous Dual-Arm Manipulation of Familiar Objects

Autonomous dual-arm manipulation is an essential skill to deploy robots ...
research
11/09/2018

Toward Autonomous Rotation-Aware Unmanned Aerial Grasping

Autonomous Unmanned Aerial Manipulators (UAMs) have shown promising pote...
research
05/17/2019

When the goal is to generate a series of activities: A self-organized simulated robot arm

Behavior is characterized by sequences of goal-oriented conducts, such a...
research
08/29/2022

A Data-Centric Approach For Dual-Arm Robotic Garment Flattening

Due to the high dimensionality of object states, a garment flattening pi...

Please sign up or login with your details

Forgot password? Click here to reset