Topic Segmentation and Labeling in Asynchronous Conversations

02/04/2014
by   Shafiq Rayhan Joty, et al.
0

Topic segmentation and labeling is often considered a prerequisite for higher-level conversation analysis and has been shown to be useful in many Natural Language Processing (NLP) applications. We present two new corpora of email and blog conversations annotated with topics, and evaluate annotator reliability for the segmentation and labeling tasks in these asynchronous conversations. We propose a complete computational framework for topic segmentation and labeling in asynchronous conversations. Our approach extends state-of-the-art methods by considering a fine-grained structure of an asynchronous conversation, along with other conversational features by applying recent graph-based methods for NLP. For topic segmentation, we propose two novel unsupervised models that exploit the fine-grained conversational structure, and a novel graph-theoretic supervised model that combines lexical, conversational and topic features. For topic labeling, we propose two novel (unsupervised) random walk models that respectively capture conversation specific clues from two different sources: the leading sentences and the fine-grained conversational structure. Empirical evaluation shows that the segmentation and the labeling performed by our best models beat the state-of-the-art, and are highly correlated with human annotations.

READ FULL TEXT

page 46

page 47

01/11/2018

Topic-based Evaluation for Conversational Bots

Dialog evaluation is a challenging problem, especially for non task-orie...
05/28/2020

Would you Like to Talk about Sports Now? Towards Contextual Topic Suggestion for Open-Domain Conversational Agents

To hold a true conversation, an intelligent agent should be able to occa...
05/06/2018

Coherence Modeling of Asynchronous Conversations: A Neural Entity Grid Approach

We propose a novel coherence model for written asynchronous conversation...
10/02/2021

TopiOCQA: Open-domain Conversational Question Answeringwith Topic Switching

In a conversational question answering scenario, a questioner seeks to e...
01/04/2022

C2-CRS: Coarse-to-Fine Contrastive Learning for Conversational Recommender System

Conversational recommender systems (CRS) aim to recommend suitable items...
09/06/2021

Proto: A Neural Cocktail for Generating Appealing Conversations

In this paper, we present our Alexa Prize Grand Challenge 4 socialbot: P...