Grounded Agreement Games: Emphasizing Conversational Grounding in Visual Dialogue Settings

08/29/2019
by   David Schlangen, et al.
0

Where early work on dialogue in Computational Linguistics put much emphasis on dialogue structure and its relation to the mental states of the dialogue participants (e.g., Allen 1979, Grosz & Sidner 1986), current work mostly reduces dialogue to the task of producing at any one time a next utterance; e.g. in neural chatbot or Visual Dialogue settings. As a methodological decision, this is sound: Even the longest journey is a sequence of steps. It becomes detrimental, however, when the tasks and datasets from which dialogue behaviour is to be learned are tailored too much to this framing of the problem. In this short note, we describe a family of settings which still allow to keep dialogues simple, but add a constraint that makes participants care about reaching mutual understanding. In such agreement games, there is a secondary, but explicit goal besides the task level goal, and that is to reach mutual understanding about whether the task level goal has been reached. As we argue, this naturally triggers meta-semantic interaction and mutual engagement, and hence leads to richer data from which to induce models.

READ FULL TEXT
research
04/11/2021

Conversational Semantic Role Labeling

Semantic role labeling (SRL) aims to extract the arguments for each pred...
research
02/13/2023

PK-ICR: Persona-Knowledge Interactive Context Retrieval for Grounded Dialogue

Identifying relevant Persona or Knowledge for conversational systems is ...
research
09/10/2023

Collecting Visually-Grounded Dialogue with A Game Of Sorts

An idealized, though simplistic, view of the referring expression produc...
research
04/18/2021

A recipe for annotating grounded clarifications

In order to interpret the communicative intents of an utterance, it need...
research
05/17/2018

Ask No More:Deciding when to guess in referential visual dialogue

Our goal is to explore how the abilities brought in by a dialogue manage...
research
07/11/2019

MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment

Building computer systems that can converse about their visual environme...
research
06/06/2022

Detecting Interlocutor Confusion in Situated Human-Avatar Dialogue: A Pilot Study

In order to enhance levels of engagement with conversational systems, ou...

Please sign up or login with your details

Forgot password? Click here to reset