Conversational Entity Linking: Problem Definition and Datasets

05/11/2021
by   Hideaki Joko, et al.
0

Machine understanding of user utterances in conversational systems is of utmost importance for enabling engaging and meaningful conversations with users. Entity Linking (EL) is one of the means of text understanding, with proven efficacy for various downstream tasks in information retrieval. In this paper, we study entity linking for conversational systems. To develop a better understanding of what EL in a conversational setting entails, we analyze a large number of dialogues from existing conversational datasets and annotate references to concepts, named entities, and personal entities using crowdsourcing. Based on the annotated dialogues, we identify the main characteristics of conversational entity linking. Further, we report on the performance of traditional EL systems on our Conversational Entity Linking dataset, ConEL, and present an extension to these methods to better fit the conversational setting. The resources released with this paper include annotated datasets, detailed descriptions of crowdsourcing setups, as well as the annotations produced by various EL systems. These new resources allow for an investigation of how the role of entities in conversations is different from that in documents or isolated short text utterances like queries and tweets, and complement existing conversational datasets.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

01/04/2021

Reddit Entity Linking Dataset

We introduce and make publicly available an entity linking dataset from ...
01/28/2022

A Unified Approach to Entity-Centric Context Tracking in Social Conversations

In human-human conversations, Context Tracking deals with identifying im...
12/31/2019

Building chatbots from large scale domain-specific knowledge bases: challenges and opportunities

Popular conversational agents frameworks such as Alexa Skills Kit (ASK) ...
08/24/2021

Robustness Evaluation of Entity Disambiguation Using Prior Probes:the Case of Entity Overshadowing

Entity disambiguation (ED) is the last step of entity linking (EL), when...
07/26/2017

Implicit Entity Linking in Tweets

Over the years, Twitter has become one of the largest communication plat...
05/28/2020

ConCET: Entity-Aware Topic Classification for Open-Domain Conversational Agents

Identifying the topic (domain) of each user's utterance in open-domain c...
06/17/2021

LNN-EL: A Neuro-Symbolic Approach to Short-text Entity Linking

Entity linking (EL), the task of disambiguating mentions in text by link...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.