PATO: Policy Assisted TeleOperation for Scalable Robot Data Collection

12/09/2022
by   Shivin Dass, et al.
0

Large-scale data is an essential component of machine learning as demonstrated in recent advances in natural language processing and computer vision research. However, collecting large-scale robotic data is much more expensive and slower as each operator can control only a single robot at a time. To make this costly data collection process efficient and scalable, we propose Policy Assisted TeleOperation (PATO), a system which automates part of the demonstration collection process using a learned assistive policy. PATO autonomously executes repetitive behaviors in data collection and asks for human input only when it is uncertain about which subtask or behavior to execute. We conduct teleoperation user studies both with a real robot and a simulated robot fleet and demonstrate that our assisted teleoperation system reduces human operators' mental load while improving data collection efficiency. Further, it enables a single operator to control multiple robots in parallel, which is a first step towards scalable robotic data collection. For code and video results, see https://clvrai.com/pato

READ FULL TEXT

page 1

page 4

page 5

page 6

page 9

research
05/10/2021

Efficient Self-Supervised Data Collection for Offline Robot Learning

A practical approach to robot reinforcement learning is to first collect...
research
08/25/2022

Elly: A Real-Time Failure Recovery and Data Collection System for Robotic Manipulation

Even the most robust autonomous behaviors can fail. The goal of this res...
research
05/17/2023

Human Choice Prediction in Language-based Non-Cooperative Games: Simulation-based Off-Policy Evaluation

Persuasion games have been fundamental in economics and AI research, and...
research
07/26/2023

Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisition

We present a framework for robot skill acquisition, which 1) efficiently...
research
12/13/2022

RT-1: Robotics Transformer for Real-World Control at Scale

By transferring knowledge from large, diverse, task-agnostic datasets, m...
research
03/22/2020

One-Shot Informed Robotic Visual Search in the Wild

We consider the task of underwater robot navigation for the purpose of c...
research
02/05/2021

Applications of Machine Learning in Document Digitisation

Data acquisition forms the primary step in all empirical research. The a...

Please sign up or login with your details

Forgot password? Click here to reset