Distant Supervision for Relation Extraction with Linear Attenuation Simulation and Non-IID Relevance Embedding

12/22/2018
by   Changsen Yuan, et al.
0

Distant supervision for relation extraction is an efficient method to reduce labor costs and has been widely used to seek novel relational facts in large corpora, which can be identified as a multi-instance multi-label problem. However, existing distant supervision methods suffer from selecting important words in the sentence and extracting valid sentences in the bag. Towards this end, we propose a novel approach to address these problems in this paper. Firstly, we propose a linear attenuation simulation to reflect the importance of words in the sentence with respect to the distances between entities and words. Secondly, we propose a non-independent and identically distributed (non-IID) relevance embedding to capture the relevance of sentences in the bag. Our method can not only capture complex information of words about hidden relations, but also express the mutual information of instances in the bag. Extensive experiments on a benchmark dataset have well-validated the effectiveness of the proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/19/2018

Improving Distantly Supervised Relation Extraction using Word and Entity Based Attention

Relation extraction is the problem of classifying the relationship betwe...
research
12/08/2020

From Bag of Sentences to Document: Distantly Supervised Relation Extraction via Machine Reading Comprehension

Distant supervision (DS) is a promising approach for relation extraction...
research
08/21/2018

Neural Relation Extraction via Inner-Sentence Noise Reduction and Transfer Learning

Extracting relations is critical for knowledge base completion and const...
research
10/30/2018

Improving Distant Supervision with Maxpooled Attention and Sentence-Level Supervision

We propose an effective multitask learning setup for reducing distant su...
research
03/10/2020

Hybrid Attention-Based Transformer Block Model for Distant Supervision Relation Extraction

With an exponential explosive growth of various digital text information...
research
06/21/2021

CIL: Contrastive Instance Learning Framework for Distantly Supervised Relation Extraction

The journey of reducing noise from distant supervision (DS) generated tr...
research
04/17/2019

Posterior-regularized REINFORCE for Instance Selection in Distant Supervision

This paper provides a new way to improve the efficiency of the REINFORCE...

Please sign up or login with your details

Forgot password? Click here to reset