Interactive Policy Learning through Confidence-Based Autonomy

01/15/2014
by   Sonia Chernova, et al.
0

We present Confidence-Based Autonomy (CBA), an interactive algorithm for policy learning from demonstration. The CBA algorithm consists of two components which take advantage of the complimentary abilities of humans and computer agents. The first component, Confident Execution, enables the agent to identify states in which demonstration is required, to request a demonstration from the human teacher and to learn a policy based on the acquired data. The algorithm selects demonstrations based on a measure of action selection confidence, and our results show that using Confident Execution the agent requires fewer demonstrations to learn the policy than when demonstrations are selected by a human teacher. The second algorithmic component, Corrective Demonstration, enables the teacher to correct any mistakes made by the agent through additional demonstrations in order to improve the policy and future task performance. CBA and its individual components are compared and evaluated in a complex simulated driving domain. The complete CBA algorithm results in the best overall learning performance, successfully reproducing the behavior of the teacher while balancing the tradeoff between number of demonstrations and number of incorrect actions during learning.

READ FULL TEXT

page 12

page 16

research
09/18/2023

One ACT Play: Single Demonstration Behavior Cloning with Action Chunking Transformers

Learning from human demonstrations (behavior cloning) is a cornerstone o...
research
07/19/2019

Interactive Learning of Environment Dynamics for Sequential Tasks

In order for robots and other artificial agents to efficiently learn to ...
research
02/26/2017

Bayesian Nonparametric Feature and Policy Learning for Decision-Making

Learning from demonstrations has gained increasing interest in the recen...
research
11/15/2022

PARTNR: Pick and place Ambiguity Resolving by Trustworthy iNteractive leaRning

Several recent works show impressive results in mapping language-based h...
research
09/27/2018

Collaborative Robot Learning from Demonstrations using Hidden Markov Model State Distribution

In robotics, there is need of an interactive and expedite learning metho...
research
06/09/2022

Pragmatically Learning from Pedagogical Demonstrations in Multi-Goal Environments

Learning from demonstration methods usually leverage close to optimal de...
research
10/16/2021

Learning UI Navigation through Demonstrations composed of Macro Actions

We have developed a framework to reliably build agents capable of UI nav...

Please sign up or login with your details

Forgot password? Click here to reset