Dynamic generation and refinement of robot verbalization

04/25/2021
by   Sai Prabhakar, et al.
0

With a growing number of robots performing autonomously without human intervention, it is difficult to understand what the robots experience along their routes during execution without looking at execution logs. Rather than looking through logs, our goal is for robots to respond to queries in natural language about what they experience and what routes they have chosen. We propose verbalization as the process of converting route experiences into natural language, and highlight the importance of varying verbalizations based on user preferences. We present our verbalization space representing different dimensions that verbalizations can be varied, and our algorithm for automatically generating them on our CoBot robot. Then we present our study of how users can request different verbalizations in dialog. Using the study data, we learn a language model to map user dialog to the verbalization space. Finally, we …

READ FULL TEXT

page 1

page 2

page 3

page 4

07/08/2019

Augmenting Knowledge through Statistical, Goal-oriented Human-Robot Dialog

Some robots can interact with humans using natural language, and identif...
05/20/2020

Learning and Reasoning for Robot Dialog and Navigation Tasks

Reinforcement learning and probabilistic reasoning algorithms aim at lea...
04/25/2021

Verbalization: Narration of Autonomous Robot Experience.

Autonomous mobile robots navigate in our spaces by planning and executin...
05/25/2022

Understanding Natural Language in Context

Recent years have seen an increasing number of applications that have a ...
08/27/2022

Robots Still Outnumber Humans in Web Archives, But Less Than Before

To identify robots and humans and analyze their respective access patter...
06/15/2018

Discovering User Groups for Natural Language Generation

We present a model which predicts how individual users of a dialog syste...
05/20/2021

Robot Action Diagnosis and Experience Correction by Falsifying Parameterised Execution Models

When faced with an execution failure, an intelligent robot should be abl...