Zero-shot Entity Linking with Dense Entity Retrieval

11/10/2019
by   Ledell Wu, et al.
0

We consider the zero-shot entity-linking challenge where each entity is defined by a short textual description, and the model must read these descriptions together with the mention context to make the final linking decisions. In this setting, retrieving entity candidates can be particularly challenging, since many of the common linking cues such as entity alias tables and link popularity are not available. In this paper, we introduce a simple and effective two stage approach for zero-shot linking, based on fine-tuned BERT architectures. In the first stage, we do retrieval in a dense space defined by a bi-encoder that independently embeds the mention context and the entity descriptions. Each candidate is then examined more carefully with a cross-encoder, that concatenates the mention and entity text. Our approach achieves a nearly 5 point absolute gain on a recently introduced zero-shot entity linking benchmark, driven largely by improvements over previous IR-based candidate retrieval. We also show that it performs well in the non-zero-shot setting, obtaining the state-of-the-art result on TACKBP-2010.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/21/2020

Clustering-based Inference for Zero-Shot Biomedical Entity Linking

Due to large number of entities in biomedical knowledge bases, only a sm...
research
08/07/2023

Improving Few-shot and Zero-shot Entity Linking with Coarse-to-Fine Lexicon-based Retriever

Few-shot and zero-shot entity linking focus on the tail and emerging ent...
research
01/30/2023

Proxy-based Zero-Shot Entity Linking by Effective Candidate Retrieval

A recent advancement in the domain of biomedical Entity Linking is the d...
research
03/06/2021

Improving Zero-Shot Entity Retrieval through Effective Dense Representations

Entity Linking (EL) seeks to align entity mentions in text to entries in...
research
10/12/2020

Zero-shot Entity Linking with Efficient Long Range Sequence Modeling

This paper considers the problem of zero-shot entity linking, in which a...
research
10/14/2022

Robust Candidate Generation for Entity Linking on Short Social Media Texts

Entity Linking (EL) is the gateway into Knowledge Bases. Recent advances...
research
08/09/2022

Early Stage Sparse Retrieval with Entity Linking

Despite the advantages of their low-resource settings, traditional spars...

Please sign up or login with your details

Forgot password? Click here to reset