Detecting and Classifying Malevolent Dialogue Responses: Taxonomy, Data and Methodology

08/21/2020
by   Yangjun Zhang, et al.
0

Conversational interfaces are increasingly popular as a way of connecting people to information. Corpus-based conversational interfaces are able to generate more diverse and natural responses than template-based or retrieval-based agents. With their increased generative capacity of corpusbased conversational agents comes the need to classify and filter out malevolent responses that are inappropriate in terms of content and dialogue acts. Previous studies on the topic of recognizing and classifying inappropriate content are mostly focused on a certain category of malevolence or on single sentences instead of an entire dialogue. In this paper, we define the task of Malevolent Dialogue Response Detection and Classification (MDRDC). We make three contributions to advance research on this task. First, we present a Hierarchical Malevolent Dialogue Taxonomy (HMDT). Second, we create a labelled multi-turn dialogue dataset and formulate the MDRDC task as a hierarchical classification task over this taxonomy. Third, we apply stateof-the-art text classification methods to the MDRDC task and report on extensive experiments aimed at assessing the performance of these approaches.

READ FULL TEXT
research
08/07/2020

Diversifying Task-oriented Dialogue Response Generation with Prototype Guided Paraphrasing

Existing methods for Dialogue Response Generation (DRG) in Task-oriented...
research
12/09/2021

"What can I cook with these ingredients?" – Understanding cooking-related information needs in conversational search

As conversational search becomes more pervasive, it becomes increasingly...
research
10/16/2019

Designing Style Matching Conversational Agents

Advances in machine intelligence have enabled conversational interfaces ...
research
10/16/2021

On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark

Dialogue safety problems severely limit the real-world deployment of neu...
research
05/24/2022

A Dataset for Sentence Retrieval for Open-Ended Dialogues

We address the task of sentence retrieval for open-ended dialogues. The ...
research
06/21/2021

Conversational Agents in Software Engineering: Survey, Taxonomy and Challenges

The use of natural language interfaces in the field of human-computer in...
research
12/06/2022

Sources of Noise in Dialogue and How to Deal with Them

Training dialogue systems often entails dealing with noisy training exam...

Please sign up or login with your details

Forgot password? Click here to reset