Learning to Share Autonomy Across Repeated Interaction

07/20/2021
by   Ananth Jonnavittula, et al.
0

Wheelchair-mounted robotic arms (and other assistive robots) should help their users perform everyday tasks. One way robots can provide this assistance is shared autonomy. Within shared autonomy, both the human and robot maintain control over the robot's motion: as the robot becomes confident it understands what the human wants, it increasingly intervenes to automate the task. But how does the robot know what tasks the human may want to perform in the first place? Today's shared autonomy approaches often rely on prior knowledge: for example, the robot must know the set of possible human goals a priori. In the long-term, however, this prior knowledge will inevitably break down – sooner or later the human will reach for a goal that the robot did not expect. In this paper we propose a learning approach to shared autonomy that takes advantage of repeated interactions. Learning to assist humans would be impossible if they performed completely different tasks at every interaction: but our insight is that users living with physical disabilities repeat important tasks on a daily basis (e.g., opening the fridge, making coffee, and having dinner). We introduce an algorithm that exploits these repeated interactions to recognize the human's task, replicate similar demonstrations, and return control when unsure. As the human repeatedly works with this robot, our approach continually learns to assist tasks that were never specified beforehand: these tasks include both discrete goals (e.g., reaching a cup) and continuous skills (e.g., opening a drawer). Across simulations and an in-person user study, we demonstrate that robots leveraging our approach match existing shared autonomy methods for known goals, and outperform imitation learning baselines on new tasks. See videos here: https://youtu.be/NazeLVbQ2og

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

research
05/19/2022

Learning to Share Autonomy from Repeated Human-Robot Interaction

Assistive robot arms try to help their users perform everyday tasks. One...
research
02/22/2022

Communicating Robot Conventions through Shared Autonomy

When humans control robot arms these robots often need to infer the huma...
research
04/14/2021

Situational Confidence Assistance for Lifelong Shared Autonomy

Shared autonomy enables robots to infer user intent and assist in accomp...
research
11/11/2020

I Know What You Meant: Learning Human Objectives by (Under)estimating Their Choice Set

Assistive robots have the potential to help people perform everyday task...
research
04/17/2023

LIMIT: Learning Interfaces to Maximize Information Transfer

Robots can use auditory, visual, or haptic interfaces to convey informat...
research
11/08/2021

Wrapped Haptic Display for Communicating Physical Robot Learning

Physical interaction between humans and robots can help robots learn to ...
research
04/10/2020

Residual Policy Learning for Shared Autonomy

Shared autonomy provides an effective framework for human-robot collabor...

Please sign up or login with your details

Forgot password? Click here to reset