Reinforcement Learning based Embodied Agents Modelling Human Users Through Interaction and Multi-Sensory Perception

01/09/2017
by   Kory W. Mathewson, et al.
0

This paper extends recent work in interactive machine learning (IML) focused on effectively incorporating human feedback. We show how control and feedback signals complement each other in systems which model human reward. We demonstrate that simultaneously incorporating human control and feedback signals can improve interactive robotic systems' performance on a self-mirrored movement control task where an RL-agent controlled right arm attempts to match the preprogrammed movement pattern of the left arm. We illustrate the impact of varying human feedback parameters on task performance by investigating the probability of giving feedback on each time step and the likelihood of given feedback being correct. We further illustrate that varying the temporal decay with which the agent incorporates human feedback has a significant impact on task performance. We found that smearing human feedback over time steps improves performance and we show varying the probability of feedback at each time step, and an increased likelihood of those feedbacks being 'correct' can impact agent performance. We conclude that understanding latent variables in human feedback is crucial for learning algorithms acting in human-machine interaction domains.

READ FULL TEXT
research
06/22/2016

Simultaneous Control and Human Feedback in the Training of a Robotic Agent with Actor-Critic Reinforcement Learning

This paper contributes a preliminary report on the advantages and disadv...
research
04/16/2018

Newtonian Action Advice: Integrating Human Verbal Instruction with Reinforcement Learning

A goal of Interactive Machine Learning (IML) is to enable people without...
research
10/14/2022

Multi-trainer Interactive Reinforcement Learning System

Interactive reinforcement learning can effectively facilitate the agent ...
research
07/20/2022

Quantifying the Effect of Feedback Frequency in Interactive Reinforcement Learning for Robotic Tasks

Reinforcement learning (RL) has become widely adopted in robot control. ...
research
08/08/2023

RLHF-Blender: A Configurable Interactive Interface for Learning from Diverse Human Feedback

To use reinforcement learning from human feedback (RLHF) in practical ap...
research
06/09/2016

Face valuing: Training user interfaces with facial expressions and reinforcement learning

An important application of interactive machine learning is extending or...
research
05/16/2023

Continually Learned Pavlovian Signalling Without Forgetting for Human-in-the-Loop Robotic Control

Artificial limbs are sophisticated devices to assist people with tasks o...

Please sign up or login with your details

Forgot password? Click here to reset