DeepAI AI Chat
Log In Sign Up

Semantic Loss Application to Entity Relation Recognition

by   Venkata Sasank Pagolu, et al.

Usually, entity relation recognition systems either use a pipe-lined model that treats the entity tagging and relation identification as separate tasks or a joint model that simultaneously identifies the relation and entities. This paper compares these two general approaches for the entity relation recognition. State-of-the-art entity relation recognition systems are built using deep recurrent neural networks which often does not capture the symbolic knowledge or the logical constraints in the problem. The main contribution of this paper is an end-to-end neural model for joint entity relation extraction which incorporates a novel loss function. This novel loss function encodes the constraint information in the problem to guide the model training effectively. We show that addition of this loss function to the existing typical loss functions has a positive impact over the performance of the models. This model is truly end-to-end, requires no feature engineering and easily extensible. Extensive experimentation has been conducted to evaluate the significance of capturing symbolic knowledge for natural language understanding. Models using this loss function are observed to be outperforming their counterparts and converging faster. Experimental results in this work suggest the use of this methodology for other language understanding applications.


page 1

page 2

page 3

page 4


Joint Learning-based Causal Relation Extraction from Biomedical Literature

Causal relation extraction of biomedical entities is one of the most com...

End-to-end neural relation extraction using deep biaffine attention

We propose a neural network model for joint extraction of named entities...

End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures

We present a novel end-to-end neural model to extract entities and relat...

Leveraging Unlabeled Data for Entity-Relation Extraction through Probabilistic Constraint Satisfaction

We study the problem of entity-relation extraction in the presence of sy...

A Semantic Loss Function for Deep Learning with Symbolic Knowledge

This paper develops a novel methodology for using symbolic knowledge in ...

Neural Feature-Adaptation for Symbolic Predictions Using Pre-Training and Semantic Loss

We are interested in neurosymbolic systems consisting of a high-level sy...