Labeling the Phrase Set of the Conversation Agent, Rinna

by   Naoki Wake, et al.

Mapping spoken text to gestures is an important research area for robots with conversation capability. However, mapping a gesture to every spoken text a priori is impossible, especially when a response is automatically generated by a conversation agent. Knowledge of human gesture characteristics can be used to map text to some semantic space where texts with similar meanings are clustered together; then, a mapped gesture is defined for each semantic cluster (i.e., concept). Here, we discuss the practical issues of obtaining concepts for the conversation agent Rinna, which has a personalized vocabulary such as short terms. We compared the concepts obtained automatically with a natural language processing approach and manually with a sociological approach, and we identified three limitations of the former: at the semantic level with emoji and symbols; at the semantic level with slang, new words, and buzzwords; and at the pragmatic level. We consider these problems to be due to the personalized vocabulary of Rinna. To solve these issues, we propose combining manual and autogenerated approaches to map texts to a semantic space. A follow-up experiment showed that a robot gesture selected based on concepts left a better impression than a randomly selected gesture, which suggests the feasibility of applying semantic space to text-to-gesture mapping. The present work contributes insights into developing a methodology for generating gestures of a conversation agent with a personalized vocabulary.



There are no comments yet.


page 6


Design of conversational humanoid robot based on hardware independent gesture generation

With an increasing need for elderly and disability care, there is an inc...

It's A Match! Gesture Generation Using Expressive Parameter Matching

Automatic gesture generation from speech generally relies on implicit mo...

Toward Automated Generation of Affective Gestures from Text:A Theory-Driven Approach

Communication in both human-human and human-robot interac-tion (HRI) con...

Toward Natural Gesture/Speech Control of a Large Display

In recent years because of the advances in computer vision research, fre...

Prosody Based Co-analysis for Continuous Recognition of Coverbal Gestures

Although speech and gesture recognition has been studied extensively, al...

A Face-to-Face Neural Conversation Model

Neural networks have recently become good at engaging in dialog. However...

Gesture Recognition with a Focus on Important Actions by Using a Path Searching Method in Weighted Graph

This paper proposes a method of gesture recognition with a focus on impo...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.