NatCS: Eliciting Natural Customer Support Dialogues

05/04/2023
by   James Gung, et al.
0

Despite growing interest in applications based on natural customer support conversations, there exist remarkably few publicly available datasets that reflect the expected characteristics of conversations in these settings. Existing task-oriented dialogue datasets, which were collected to benchmark dialogue systems mainly in written human-to-bot settings, are not representative of real customer support conversations and do not provide realistic benchmarks for systems that are applied to natural data. To address this gap, we introduce NatCS, a multi-domain collection of spoken customer service conversations. We describe our process for collecting synthetic conversations between customers and agents based on natural language phenomena observed in real conversations. Compared to previous dialogue datasets, the conversations collected with our approach are more representative of real human-to-human conversations along multiple metrics. Finally, we demonstrate potential uses of NatCS, including dialogue act classification and intent induction from conversations as potential applications, showing that dialogue act annotations in NatCS provide more effective training data for modeling real conversations compared to existing synthetic written datasets. We publicly release NatCS to facilitate research in natural dialog systems

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/23/2021

TOD-DA: Towards Boosting the Robustness of Task-oriented Dialogue Modeling on Spoken Conversations

Task-oriented dialogue systems have been plagued by the difficulties of ...
research
04/25/2023

Intent Induction from Conversations for Task-Oriented Dialogue Track at DSTC 11

With increasing demand for and adoption of virtual assistants, recent wo...
research
03/08/2023

FaceChat: An Emotion-Aware Face-to-face Dialogue Framework

While current dialogue systems like ChatGPT have made significant advanc...
research
07/16/2018

Don't get Lost in Negation: An Effective Negation Handled Dialogue Acts Prediction Algorithm for Twitter Customer Service Conversations

In the last several years, Twitter is being adopted by the companies as ...
research
07/03/2019

Chatbots as Unwitting Actors

Chatbots are popular for both task-oriented conversations and unstructur...
research
03/12/2022

A combined approach to the analysis of speech conversations in a contact center domain

The ever more accurate search for deep analysis in customer data is a re...
research
09/27/2022

Information Extraction and Human-Robot Dialogue towards Real-life Tasks: A Baseline Study with the MobileCS Dataset

Recently, there have merged a class of task-oriented dialogue (TOD) data...

Please sign up or login with your details

Forgot password? Click here to reset