Multi-stage Clarification in Conversational AI: The case of Question-Answering Dialogue Systems

10/28/2021
by   Hadrien Lautraite, et al.
BANQUE NATIONALE DU CANADA
0

Clarification resolution plays an important role in various information retrieval tasks such as interactive question answering and conversational search. In such context, the user often formulates their information needs as short and ambiguous queries, some popular search interfaces then prompt the user to confirm her intent (e.g. "Did you mean ... ?") or to rephrase if needed. When it comes to dialogue systems, having fluid user-bot exchanges is key to good user experience. In the absence of such clarification mechanism, one of the following responses is given to the user: 1) A direct answer, which can potentially be non-relevant if the intent was not clear, 2) a generic fallback message informing the user that the retrieval tool is incapable of handling the query. Both scenarios might raise frustration and degrade the user experience. To this end, we propose a multi-stage clarification mechanism for prompting clarification and query selection in the context of a question answering dialogue system. We show that our proposed mechanism improves the overall user experience and outperforms competitive baselines with two datasets, namely the public in-scope out-of-scope dataset and a commercial dataset based on real user logs.

READ FULL TEXT
12/16/2021

CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learning

For open-domain conversational question answering (CQA), it is important...
09/10/2021

Refocusing on Relevance: Personalization in NLG

Many NLG tasks such as summarization, dialogue response, or open domain ...
05/25/2019

Evaluating Variable-Length Multiple-Option Lists in Chatbots and Mobile Search

In recent years, the proliferation of smart mobile devices has lead to t...
04/05/2023

Ericson: An Interactive Open-Domain Conversational Search Agent

Open-domain conversational search (ODCS) aims to provide valuable, up-to...
08/27/2019

Real-world Conversational AI for Hotel Bookings

In this paper, we present a real-world conversational AI system to searc...
04/27/2023

Answering Uncertain, Under-Specified API Queries Assisted by Knowledge-Aware Human-AI Dialogue

Developers' API needs should be more pragmatic, such as seeking suggesti...
07/31/2023

Olio: A Semantic Search Interface for Data Repositories

Search and information retrieval systems are becoming more expressive in...

Please sign up or login with your details

Forgot password? Click here to reset