Sequential annotations for naturally-occurring HRI: first insights

08/29/2023
by   Lucien Tisserand, et al.
0

We explain the methodology we developed for improving the interactions accomplished by an embedded conversational agent, drawing from Conversation Analytic sequential and multimodal analysis. The use case is a Pepper robot that is expected to inform and orient users in a library. In order to propose and learn better interactive schema, we are creating a corpus of naturally-occurring interactions that will be made available to the community. To do so, we propose an annotation practice based on some theoretical underpinnings about the use of language and multimodal resources in human-robot interaction. CCS CONCEPTS ∙ Computing methodologies → Discourse, dialogue and pragmatics; ∙ Human-centered computing → Text input; HCI theory, concepts and models; Field studies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/08/2017

Sympathy Begins with a Smile, Intelligence Begins with a Word: Use of Multimodal Features in Spoken Human-Robot Interaction

Recognition of social signals, from human facial expressions or prosody ...
research
06/11/2021

How Should Agents Ask Questions For Situated Learning? An Annotated Dialogue Corpus

Intelligent agents that are confronted with novel concepts in situated e...
research
10/22/2022

MILD: Multimodal Interactive Latent Dynamics for Learning Human-Robot Interaction

Modeling interaction dynamics to generate robot trajectories that enable...
research
07/21/2018

Consequences and Factors of Stylistic Differences in Human-Robot Dialogue

This paper identifies stylistic differences in instruction-giving observ...
research
11/24/2022

On the Linguistic and Computational Requirements for Creating Face-to-Face Multimodal Human-Machine Interaction

In this study, conversations between humans and avatars are linguistical...
research
12/30/2021

An empirical user-study of text-based nonverbal annotation systems for human-human conversations

the substantial increase in the number of online human-human conversatio...
research
09/18/2019

Multimodal Continuation-style Architectures for Human-Robot Interaction

We present an architecture for integrating real-time, multimodal input i...

Please sign up or login with your details

Forgot password? Click here to reset