DeepAI AI Chat
Log In Sign Up

EDIN: An End-to-end Benchmark and Pipeline for Unknown Entity Discovery and Indexing

by   Nora Kassner, et al.

Existing work on Entity Linking mostly assumes that the reference knowledge base is complete, and therefore all mentions can be linked. In practice this is hardly ever the case, as knowledge bases are incomplete and because novel concepts arise constantly. This paper created the Unknown Entity Discovery and Indexing (EDIN) benchmark where unknown entities, that is entities without a description in the knowledge base and labeled mentions, have to be integrated into an existing entity linking system. By contrasting EDIN with zero-shot entity linking, we provide insight on the additional challenges it poses. Building on dense-retrieval based entity linking, we introduce the end-to-end EDIN pipeline that detects, clusters, and indexes mentions of unknown entities in context. Experiments show that indexing a single embedding per entity unifying the information of multiple mentions works better than indexing mentions independently.


NASTyLinker: NIL-Aware Scalable Transformer-based Entity Linker

Entity Linking (EL) is the task of detecting mentions of entities in tex...

Linking Graph Entities with Multiplicity and Provenance

Entity linking is a fundamental database problem with applicationsin dat...

Entity Linking and Discovery via Arborescence-based Supervised Clustering

Previous work has shown promising results in performing entity linking b...

Find the Funding: Entity Linking with Incomplete Funding Knowledge Bases

Automatic extraction of funding information from academic articles adds ...

Linking Entities to Unseen Knowledge Bases with Arbitrary Schemas

In entity linking, mentions of named entities in raw text are disambigua...

Proxy-based Zero-Shot Entity Linking by Effective Candidate Retrieval

A recent advancement in the domain of biomedical Entity Linking is the d...

Towards Deep Semantic Analysis Of Hashtags

Hashtags are semantico-syntactic constructs used across various social n...