Robot Learning on the Job: Human-in-the-Loop Autonomy and Learning During Deployment

by   Huihan Liu, et al.

With the rapid growth of computing powers and recent advances in deep learning, we have witnessed impressive demonstrations of novel robot capabilities in research settings. Nonetheless, these learning systems exhibit brittle generalization and require excessive training data for practical tasks. To harness the capabilities of state-of-the-art robot learning models while embracing their imperfections, we present Sirius, a principled framework for humans and robots to collaborate through a division of work. In this framework, partially autonomous robots are tasked with handling a major portion of decision-making where they work reliably; meanwhile, human operators monitor the process and intervene in challenging situations. Such a human-robot team ensures safe deployments in complex tasks. Further, we introduce a new learning algorithm to improve the policy's performance on the data collected from the task executions. The core idea is re-weighing training samples with approximated human trust and optimizing the policies with weighted behavioral cloning. We evaluate Sirius in simulation and on real hardware, showing that Sirius consistently outperforms baselines over a collection of contact-rich manipulation tasks, achieving 8 than the state-of-the-art methods, with 3 times faster convergence and 15 memory size. Videos and code are available at


page 1

page 5

page 6

page 9

page 12


Human-in-the-Loop Imitation Learning using Remote Teleoperation

Imitation Learning is a promising paradigm for learning complex robot ma...

Trust Calibration and Trust Respect: A Method for Building Team Cohesion in Human Robot Teams

Recent advances in the areas of human-robot interaction (HRI) and robot ...

Accelerating Interactive Human-like Manipulation Learning with GPU-based Simulation and High-quality Demonstrations

Dexterous manipulation with anthropomorphic robot hands remains a challe...

The Transfer of Human Trust in Robot Capabilities across Tasks

Trust is crucial in shaping human interactions with one another and with...

A Study in Zucker: Insights on Human-Robot Interactions

In recent years there has been a large focus on how robots can operate i...

Adaptive Workload Allocation for Multi-human Multi-robot Teams for Independent and Homogeneous Tasks

Multi-human multi-robot (MH-MR) systems have the ability to combine the ...

Hierarchical Planning and Policy Shaping Shared Autonomy for Articulated Robots

In this work, we propose a novel shared autonomy framework to operate ar...

Please sign up or login with your details

Forgot password? Click here to reset