On Optimizing Interventions in Shared Autonomy

12/16/2021
by   Weihao Tan, et al.
11

Shared autonomy refers to approaches for enabling an autonomous agent to collaborate with a human with the aim of improving human performance. However, besides improving performance, it may often also be beneficial that the agent concurrently accounts for preserving the user's experience or satisfaction of collaboration. In order to address this additional goal, we examine approaches for improving the user experience by constraining the number of interventions by the autonomous agent. We propose two model-free reinforcement learning methods that can account for both hard and soft constraints on the number of interventions. We show that not only does our method outperform the existing baseline, but also eliminates the need to manually tune a black-box hyperparameter for controlling the level of assistance. We also provide an in-depth analysis of intervention scenarios in order to further illuminate system understanding.

READ FULL TEXT

page 7

page 12

page 15

page 16

page 17

page 18

research
10/19/2022

When to Ask for Help: Proactive Interventions in Autonomous Reinforcement Learning

A long-term goal of reinforcement learning is to design agents that can ...
research
04/10/2020

Residual Policy Learning for Shared Autonomy

Shared autonomy provides an effective framework for human-robot collabor...
research
03/06/2023

Reducing Safety Interventions in Provably Safe Reinforcement Learning

Deep Reinforcement Learning (RL) has shown promise in addressing complex...
research
03/01/2023

Automated Task-Time Interventions to Improve Teamwork using Imitation Learning

Effective human-human and human-autonomy teamwork is critical but often ...
research
05/27/2022

Generating personalized counterfactual interventions for algorithmic recourse by eliciting user preferences

Counterfactual interventions are a powerful tool to explain the decision...
research
04/16/2020

Should I tear down this wall? Optimizing social metrics by evaluating novel actions

One of the fundamental challenges of governance is deciding when and how...
research
12/29/2018

EMMA: An Emotionally Intelligent Personal Assistant for Improving Wellbeing

The delivery of mental health interventions via ubiquitous devices has s...

Please sign up or login with your details

Forgot password? Click here to reset