CROWN: Conversational Passage Ranking by Reasoning over Word Networks

11/07/2019
by   Magdalena Kaiser, et al.
0

Information needs around a topic cannot be satisfied in a single turn; users typically ask follow-up questions referring to the same theme and a system must be capable of understanding the conversational context of a request to retrieve correct answers. In this paper, we present our submission to the TREC Conversational Assistance Track 2019, in which such a conversational setting is explored. We propose a simple unsupervised method for conversational passage ranking by formulating the passage score for a query as a combination of similarity and coherence. To be specific, passages are preferred that contain words semantically similar to the words used in the question, and where such words appear close by. We built a word-proximity network (WPN) from a large corpus, where words are nodes and there is an edge between two nodes if they co-occur in the same passages in a statistically significant way, within a context window. Our approach, named CROWN, improved nDCG scores over a provided Indri baseline on the CAsT training data. On the evaluation data for CAsT, our best run submission achieved above-average performance with respect to AP@5 and nDCG@1000.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/27/2020

Conversational Question Answering over Passages by Leveraging Word Proximity Networks

Question answering (QA) over text passages is a problem of long-standing...
research
02/26/2021

Open-domain question classification and completion in conversational information search

Searching for new information requires talking to the system. In this re...
research
03/30/2020

TREC CAsT 2019: The Conversational Assistance Track Overview

The Conversational Assistance Track (CAsT) is a new track for TREC 2019 ...
research
05/05/2020

Query Reformulation using Query History for Passage Retrieval in Conversational Search

Passage retrieval in a conversational context is essential for many down...
research
05/13/2018

Learning to Ask Questions in Open-domain Conversational Systems with Typed Decoders

Asking good questions in large-scale, open-domain conversational systems...
research
08/09/2022

Unsupervised Question Clarity Prediction Through Retrieved Item Coherency

Despite recent progress on conversational systems, they still do not per...
research
10/01/2021

Sentiment and structure in word co-occurrence networks on Twitter

We explore the relationship between context and happiness scores in poli...

Please sign up or login with your details

Forgot password? Click here to reset