Conversational Entity Linking: Problem Definition and Datasets

by   Hideaki Joko, et al.

Machine understanding of user utterances in conversational systems is of utmost importance for enabling engaging and meaningful conversations with users. Entity Linking (EL) is one of the means of text understanding, with proven efficacy for various downstream tasks in information retrieval. In this paper, we study entity linking for conversational systems. To develop a better understanding of what EL in a conversational setting entails, we analyze a large number of dialogues from existing conversational datasets and annotate references to concepts, named entities, and personal entities using crowdsourcing. Based on the annotated dialogues, we identify the main characteristics of conversational entity linking. Further, we report on the performance of traditional EL systems on our Conversational Entity Linking dataset, ConEL, and present an extension to these methods to better fit the conversational setting. The resources released with this paper include annotated datasets, detailed descriptions of crowdsourcing setups, as well as the annotations produced by various EL systems. These new resources allow for an investigation of how the role of entities in conversations is different from that in documents or isolated short text utterances like queries and tweets, and complement existing conversational datasets.



There are no comments yet.


page 1

page 2

page 3

page 4


Reddit Entity Linking Dataset

We introduce and make publicly available an entity linking dataset from ...

A Unified Approach to Entity-Centric Context Tracking in Social Conversations

In human-human conversations, Context Tracking deals with identifying im...

Building chatbots from large scale domain-specific knowledge bases: challenges and opportunities

Popular conversational agents frameworks such as Alexa Skills Kit (ASK) ...

Robustness Evaluation of Entity Disambiguation Using Prior Probes:the Case of Entity Overshadowing

Entity disambiguation (ED) is the last step of entity linking (EL), when...

Implicit Entity Linking in Tweets

Over the years, Twitter has become one of the largest communication plat...

ConCET: Entity-Aware Topic Classification for Open-Domain Conversational Agents

Identifying the topic (domain) of each user's utterance in open-domain c...

LNN-EL: A Neuro-Symbolic Approach to Short-text Entity Linking

Entity linking (EL), the task of disambiguating mentions in text by link...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.