An Annotated Corpus of Relational Strategies in Customer Service

08/17/2017
by   Ian Beaver, et al.
0

We create and release the first publicly available commercial customer service corpus with annotated relational segments. Human-computer data from three live customer service Intelligent Virtual Agents (IVAs) in the domains of travel and telecommunications were collected, and reviewers marked all text that was deemed unnecessary to the determination of user intention. After merging the selections of multiple reviewers to create highlighted texts, a second round of annotation was done to determine the classes of language present in the highlighted sections such as the presence of Greetings, Backstory, Justification, Gratitude, Rants, or Emotions. This resulting corpus is a valuable resource for improving the quality and relational abilities of IVAs. As well as discussing the corpus itself, we compare the usage of such language in human-human interactions on TripAdvisor forums. We show that removal of this language from task-based inputs has a positive effect on IVA understanding by both an increase in confidence and improvement in responses, demonstrating the need for automated methods of its discovery.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/05/2021

Evaluating Empathetic Chatbots in Customer Service Settings

Customer service is a setting that calls for empathy in live human agent...
research
06/11/2021

How Should Agents Ask Questions For Situated Learning? An Annotated Dialogue Corpus

Intelligent agents that are confronted with novel concepts in situated e...
research
11/15/2017

Detecting Egregious Conversations between Customers and Virtual Agents

Virtual agents are becoming a prominent channel of interaction in custom...
research
05/20/2018

The UN Parallel Corpus Annotated for Translation Direction

This work distinguishes between translated and original text in the UN p...
research
11/26/2018

Beyond "How may I help you?": Assisting Customer Service Agents with Proactive Responses

We study the problem of providing recommended responses to customer serv...
research
06/08/2017

The Algorithmic Inflection of Russian and Generation of Grammatically Correct Text

We present a deterministic algorithm for Russian inflection. This algori...
research
07/20/2023

Towards an architectural framework for intelligent virtual agents using probabilistic programming

We present a new framework called KorraAI for conceiving and building em...

Please sign up or login with your details

Forgot password? Click here to reset