DeepAI AI Chat
Log In Sign Up

Attending to All Mention Pairs for Full Abstract Biological Relation Extraction

10/23/2017
by   Patrick Verga, et al.
University of Massachusetts Amherst
Chan Zuckerberg Initiative LLC
0

Most work in relation extraction forms a prediction by looking at a short span of text within a single sentence containing a single entity pair mention. However, many relation types, particularly in biomedical text, are expressed across sentences or require a large context to disambiguate. We propose a model to consider all mention and entity pairs simultaneously in order to make a prediction. We encode full paper abstracts using an efficient self-attention encoder and form pairwise predictions between all mentions with a bi-affine operation. An entity-pair wise pooling aggregates mention pair scores to make a final prediction while alleviating training noise by performing within document multi-instance learning. We improve our model's performance by jointly training the model to predict named entities and adding an additional corpus of weakly labeled data. We demonstrate our model's effectiveness by achieving the state of the art on the Biocreative V Chemical Disease Relation dataset for models without KB resources, outperforming ensembles of models which use hand-crafted features and additional linguistic resources.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/28/2018

Simultaneously Self-Attending to All Mentions for Full-Abstract Biological Relation Extraction

Most work in relation extraction forms a prediction by looking at a shor...
09/11/2019

Global Locality in Event Extraction

Due to the exponential growth of biomedical literature, event and relati...
12/21/2020

Document-Level Relation Extraction with Reconstruction

In document-level relation extraction (DocRE), graph structure is genera...
08/31/2019

Connecting the Dots: Document-level Neural Relation Extraction with Edge-oriented Graphs

Document-level relation extraction is a complex human process that requi...
02/20/2021

Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction

Entities, as the essential elements in relation extraction tasks, exhibi...
04/17/2020

Probing Linguistic Features of Sentence-Level Representations in Neural Relation Extraction

Despite the recent progress, little is known about the features captured...
11/20/2020

Learning Informative Representations of Biomedical Relations with Latent Variable Models

Extracting biomedical relations from large corpora of scientific documen...