A Large-Scale Analysis of Mixed Initiative in Information-Seeking Dialogues for Conversational Search

by   Svitlana Vakulenko, et al.

Conversational search is a relatively young area of research that aims at automating an information-seeking dialogue. In this paper we help to position it with respect to other research areas within conversational Artificial Intelligence (AI) by analysing the structural properties of an information-seeking dialogue. To this end, we perform a large-scale dialogue analysis of more than 150K transcripts from 15 publicly available dialogue datasets. These datasets were collected to inform different dialogue-based tasks including conversational search. We extract different patterns of mixed initiative from these dialogue transcripts and use them to compare dialogues of different types. Moreover, we contrast the patterns found in information-seeking dialogues that are being used for research purposes with the patterns found in virtual reference interviews that were conducted by professional librarians. The insights we provide (1) establish close relations between conversational search and other conversational AI tasks; and (2) uncover limitations of existing conversational datasets to inform future data collection tasks.


page 1

page 19


An Analysis of Mixed Initiative and Collaboration in Information-Seeking Dialogues

The ability to engage in mixed-initiative interaction is one of the core...

Introducing MANtIS: a novel Multi-Domain Information Seeking Dialogues Dataset

Conversational search is an approach to information retrieval (IR), wher...

Personalization Trade-offs in Designing a Dialogue-based Information System for Support-Seeking of Sexual Violence Survivors

The lack of reliable, personalized information often complicates sexual ...

Where is the context? – A critique of recent dialogue datasets

Recent dialogue datasets like MultiWOZ 2.1 and Taskmaster-1 constitute s...

Conversational Information Seeking

Conversational information seeking (CIS) is concerned with a sequence of...

Information search in a professional context - exploring a collection of professional search tasks

Search conducted in a work context is an everyday activity that has been...

LARD: Large-scale Artificial Disfluency Generation

Disfluency detection is a critical task in real-time dialogue systems. H...