Dynamic generation and refinement of robot verbalization

by   Sai Prabhakar, et al.

With a growing number of robots performing autonomously without human intervention, it is difficult to understand what the robots experience along their routes during execution without looking at execution logs. Rather than looking through logs, our goal is for robots to respond to queries in natural language about what they experience and what routes they have chosen. We propose verbalization as the process of converting route experiences into natural language, and highlight the importance of varying verbalizations based on user preferences. We present our verbalization space representing different dimensions that verbalizations can be varied, and our algorithm for automatically generating them on our CoBot robot. Then we present our study of how users can request different verbalizations in dialog. Using the study data, we learn a language model to map user dialog to the verbalization space. Finally, we …


page 1

page 2

page 3

page 4


Augmenting Knowledge through Statistical, Goal-oriented Human-Robot Dialog

Some robots can interact with humans using natural language, and identif...

Learning and Reasoning for Robot Dialog and Navigation Tasks

Reinforcement learning and probabilistic reasoning algorithms aim at lea...

Verbalization: Narration of Autonomous Robot Experience.

Autonomous mobile robots navigate in our spaces by planning and executin...

Understanding Natural Language in Context

Recent years have seen an increasing number of applications that have a ...

Robots Still Outnumber Humans in Web Archives, But Less Than Before

To identify robots and humans and analyze their respective access patter...

Discovering User Groups for Natural Language Generation

We present a model which predicts how individual users of a dialog syste...

Robot Action Diagnosis and Experience Correction by Falsifying Parameterised Execution Models

When faced with an execution failure, an intelligent robot should be abl...