Learning Manner of Execution from Partial Corrections

02/07/2023
by   Mattias Appelgren, et al.
0

Some actions must be executed in different ways depending on the context. For example, wiping away marker requires vigorous force while wiping away almonds requires more gentle force. In this paper we provide a model where an agent learns which manner of action execution to use in which context, drawing on evidence from trial and error and verbal corrections when it makes a mistake (e.g., “no, gently”). The learner starts out with a domain model that lacks the concepts denoted by the words in the teacher's feedback; both the words describing the context (e.g., marker) and the adverbs like “gently”. We show that through the the semantics of coherence, our agent can perform the symbol grounding that's necessary for exploiting the teacher's feedback so as to solve its domain-level planning problem: to perform its actions in the current context in the right way.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/05/2023

Interactive Acquisition of Fine-grained Visual Concepts by Exploiting Semantics of Generic Characterizations in Discourse

Interactive Task Learning (ITL) concerns learning about unforeseen domai...
research
03/28/2017

A Deep Compositional Framework for Human-like Language Acquisition in Virtual Environment

We tackle a task where an agent learns to navigate in a 2D maze-like env...
research
01/31/2018

Interactive Grounded Language Acquisition and Generalization in a 2D World

We build a virtual agent for learning language in a 2D maze-like world. ...
research
04/02/2021

Learning Online from Corrective Feedback: A Meta-Algorithm for Robotics

A key challenge in Imitation Learning (IL) is that optimal state actions...
research
09/26/2022

Overcoming Referential Ambiguity in Language-Guided Goal-Conditioned Reinforcement Learning

Teaching an agent to perform new tasks using natural language can easily...
research
08/03/2020

Action sequencing using visual permutations

Humans can easily reason about the sequence of high level actions needed...
research
05/22/2023

Yes, this Way! Learning to Ground Referring Expressions into Actions with Intra-episodic Feedback from Supportive Teachers

The ability to pick up on language signals in an ongoing interaction is ...

Please sign up or login with your details

Forgot password? Click here to reset