DeepAI AI Chat
Log In Sign Up

Proxy-based Zero-Shot Entity Linking by Effective Candidate Retrieval

01/30/2023
by   Maciej Wiatrak, et al.
BenevolentAI
0

A recent advancement in the domain of biomedical Entity Linking is the development of powerful two-stage algorithms, an initial candidate retrieval stage that generates a shortlist of entities for each mention, followed by a candidate ranking stage. However, the effectiveness of both stages are inextricably dependent on computationally expensive components. Specifically, in candidate retrieval via dense representation retrieval it is important to have hard negative samples, which require repeated forward passes and nearest neighbour searches across the entire entity label set throughout training. In this work, we show that pairing a proxy-based metric learning loss with an adversarial regularizer provides an efficient alternative to hard negative sampling in the candidate retrieval stage. In particular, we show competitive performance on the recall@1 metric, thereby providing the option to leave out the expensive candidate ranking step. Finally, we demonstrate how the model can be used in a zero-shot setting to discover out of knowledge base biomedical entities.

READ FULL TEXT

page 3

page 7

page 12

11/10/2019

Zero-shot Entity Linking with Dense Entity Retrieval

We consider the zero-shot entity-linking challenge where each entity is ...
09/02/2021

Entity Linking and Discovery via Arborescence-based Supervised Clustering

Previous work has shown promising results in performing entity linking b...
03/06/2021

Improving Zero-Shot Entity Retrieval through Effective Dense Representations

Entity Linking (EL) seeks to align entity mentions in text to entries in...
05/25/2022

EDIN: An End-to-end Benchmark and Pipeline for Unknown Entity Discovery and Indexing

Existing work on Entity Linking mostly assumes that the reference knowle...
07/26/2022

Hansel: A Chinese Few-Shot and Zero-Shot Entity Linking Benchmark

Modern Entity Linking (EL) systems entrench a popularity bias, yet there...
08/09/2022

Early Stage Sparse Retrieval with Entity Linking

Despite the advantages of their low-resource settings, traditional spars...
10/14/2022

Robust Candidate Generation for Entity Linking on Short Social Media Texts

Entity Linking (EL) is the gateway into Knowledge Bases. Recent advances...