A Lightweight Neural Model for Biomedical Entity Linking

12/16/2020
by   Lihu Chen, et al.
0

Biomedical entity linking aims to map biomedical mentions, such as diseases and drugs, to standard entities in a given knowledge base. The specific challenge in this context is that the same biomedical entity can have a wide range of names, including synonyms, morphological variations, and names with different word orderings. Recently, BERT-based methods have advanced the state-of-the-art by allowing for rich representations of word sequences. However, they often have hundreds of millions of parameters and require heavy computing resources, which limits their applications in resource-limited scenarios. Here, we propose a lightweight neural method for biomedical entity linking, which needs just a fraction of the parameters of a BERT model and much less computing resources. Our method uses a simple alignment layer with attention mechanisms to capture the variations between mention and entity names. Yet, we show that our model is competitive with previous work on standard evaluation benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/06/2021

BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Residual Convolutional Neural Networks

Biomedical entity linking is the task of linking entity mentions in a bi...
research
03/08/2021

Fast and Effective Biomedical Entity Linking Using a Dual Encoder

Biomedical entity linking is the task of identifying mentions of biomedi...
research
06/14/2021

Biomedical Entity Linking with Contrastive Context Matching

We introduce BioCoM, a contrastive learning framework for biomedical ent...
research
10/22/2020

Self-alignment Pre-training for Biomedical Entity Representations

Despite the widespread success of self-supervised learning via masked la...
research
04/11/2022

Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning

Entities lie in the heart of biomedical natural language understanding, ...
research
03/18/2023

Exploring Partial Knowledge Base Inference in Biomedical Entity Linking

Biomedical entity linking (EL) consists of named entity recognition (NER...
research
10/24/2020

Disease Normalization with Graph Embeddings

The detection and normalization of diseases in biomedical texts are key ...

Please sign up or login with your details

Forgot password? Click here to reset