Analyzing Assumptions in Conversation Disentanglement Research Through the Lens of a New Dataset and Model

10/25/2018
by   Jonathan K. Kummerfeld, et al.
0

Disentangling conversations mixed together in a single stream of messages is a difficult task with no large annotated datasets. We created a new dataset that is 25 times the size of any previous publicly available resource, has samples of conversation from 152 points in time across a decade, and is annotated with both threads and a within-thread reply-structure graph. We also developed a new neural network model, which extracts conversation threads substantially more accurately than prior work. Using our annotated data and our model we tested assumptions in prior work, revealing major issues in heuristically constructed resources, and identifying how small datasets have biased our understanding of multi-party multi-conversation chat.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/11/2021

DeliData: A dataset for deliberation in multi-party problem solving

Dialogue systems research is traditionally focused on dialogues between ...
research
04/08/2020

DialBERT: A Hierarchical Pre-Trained Model for Conversation Disentanglement

Disentanglement is a problem in which multiple conversations occur in th...
research
06/26/2019

Analyzing Verbal and Nonverbal Features for Predicting Group Performance

This work analyzes the efficacy of verbal and nonverbal features of grou...
research
10/14/2020

Six Attributes of Unhealthy Conversation

We present a new dataset of approximately 44000 comments labeled by crow...
research
09/07/2021

Unsupervised Conversation Disentanglement through Co-Training

Conversation disentanglement aims to separate intermingled messages into...
research
05/26/2023

Dramatic Conversation Disentanglement

We present a new dataset for studying conversation disentanglement in mo...
research
03/26/2018

On Chatbots Exhibiting Goal-Directed Autonomy in Dynamic Environments

Conversation interfaces (CIs), or chatbots, are a popular form of intell...

Please sign up or login with your details

Forgot password? Click here to reset