Enriched Attention for Robust Relation Extraction

04/22/2021
by   Heike Adel, et al.
0

The performance of relation extraction models has increased considerably with the rise of neural networks. However, a key issue of neural relation extraction is robustness: the models do not scale well to long sentences with multiple entities and relations. In this work, we address this problem with an enriched attention mechanism. Attention allows the model to focus on parts of the input sentence that are relevant to relation extraction. We propose to enrich the attention function with features modeling knowledge about the relation arguments and the shortest dependency path between them. Thus, for different relation arguments, the model can pay attention to different parts of the sentence. Our model outperforms prior work using comparable setups on two popular benchmarks, and our analysis confirms that it indeed scales to long sentences with many entities.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/09/2019

Effective Attention Modeling for Neural Relation Extraction

Relation extraction is the task of determining the relation between two ...
research
03/24/2019

Relation extraction between the clinical entities based on the shortest dependency path based LSTM

Owing to the exponential rise in the electronic medical records, informa...
research
09/26/2020

Reinforcement Learning-based N-ary Cross-Sentence Relation Extraction

The models of n-ary cross sentence relation extraction based on distant ...
research
01/11/2021

BERT-GT: Cross-sentence n-ary relation extraction with BERT and Graph Transformer

A biomedical relation statement is commonly expressed in multiple senten...
research
06/05/2020

Relation of the Relations: A New Paradigm of the Relation Extraction Problem

In natural language, often multiple entities appear in the same text. Ho...
research
06/15/2020

Extracting N-ary Cross-sentence Relations using Constrained Subsequence Kernel

Most of the past work in relation extraction deals with relations occurr...
research
07/29/2020

Improving Performance of Relation Extraction Algorithm via Leveled Adversarial PCNN and Database Expansion

This study introduces database expansion using the Minimum Description L...

Please sign up or login with your details

Forgot password? Click here to reset