Learning to Fold Real Garments with One Arm: A Case Study in Cloud-Based Robotics Research

04/21/2022
by   Ryan Hoque, et al.
47

Autonomous fabric manipulation is a longstanding challenge in robotics, but evaluating progress is difficult due to the cost and diversity of robot hardware. Using Reach, a cloud robotics platform that enables low-latency remote execution of control policies on physical robots, we present the first systematic benchmarking of fabric manipulation algorithms on physical hardware. We develop 4 novel learning-based algorithms that model expert actions, keypoints, reward functions, and dynamic motions, and we compare these against 4 learning-free and inverse dynamics algorithms on the task of folding a crumpled T-shirt with a single robot arm. The entire lifecycle of data collection, model training, and policy evaluation is performed remotely without physical access to the robot workcell. Results suggest a new algorithm combining imitation learning with analytic methods achieves 84 performance on the folding task. See https://sites.google.com/berkeley.edu/cloudfolding for all data, code, models, and supplemental material.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 9

page 11

page 12

research
12/12/2020

Human-in-the-Loop Imitation Learning using Remote Teleoperation

Imitation Learning is a promising paradigm for learning complex robot ma...
research
12/12/2020

Learning Multi-Arm Manipulation Through Collaborative Teleoperation

Imitation Learning (IL) is a powerful paradigm to teach robots to perfor...
research
11/05/2022

Learning Fabric Manipulation in the Real World with Human Videos

Fabric manipulation is a long-standing challenge in robotics due to the ...
research
06/21/2023

One Policy to Dress Them All: Learning to Dress People with Diverse Poses and Garments

Robot-assisted dressing could benefit the lives of many people such as o...
research
09/28/2020

Amodal 3D Reconstruction for Robotic Manipulation via Stability and Connectivity

Learning-based 3D object reconstruction enables single- or few-shot esti...
research
09/09/2020

Integrated Benchmarking and Design for Reproducible and Accessible Evaluation of Robotic Agents

As robotics matures and increases in complexity, it is more necessary th...
research
06/29/2023

FogROS2-SGC: A ROS2 Cloud Robotics Platform for Secure Global Connectivity

The Robot Operating System (ROS2) is the most widely used software platf...

Please sign up or login with your details

Forgot password? Click here to reset