Learning with Noise: Enhance Distantly Supervised Relation Extraction with Dynamic Transition Matrix

05/11/2017
by   Bingfeng Luo, et al.
0

Distant supervision significantly reduces human efforts in building training data for many classification tasks. While promising, this technique often introduces noise to the generated training data, which can severely affect the model performance. In this paper, we take a deep look at the application of distant supervision in relation extraction. We show that the dynamic transition matrix can effectively characterize the noise in the training data built by distant supervision. The transition matrix can be effectively trained using a novel curriculum learning based method without any direct supervision about the noise. We thoroughly evaluate our approach under a wide range of extraction scenarios. Experimental results show that our approach consistently improves the extraction results and outperforms the state-of-the-art in various evaluation scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/22/2021

Improving Distantly Supervised Relation Extraction with Self-Ensemble Noise Filtering

Distantly supervised models are very popular for relation extraction sin...
research
09/12/2015

Improving distant supervision using inference learning

Distant supervision is a widely applied approach to automatic training o...
research
06/28/2023

LLM Calibration and Automatic Hallucination Detection via Pareto Optimal Self-supervision

Large language models (LLMs) have demonstrated remarkable capabilities o...
research
05/18/2022

Relation Extraction with Weighted Contrastive Pre-training on Distant Supervision

Contrastive pre-training on distant supervision has shown remarkable eff...
research
08/12/2020

Distantly Supervised Relation Extraction in Federated Settings

This paper investigates distantly supervised relation extraction in fede...
research
09/12/2019

Uncover the Ground-Truth Relations in Distant Supervision: A Neural Expectation-Maximization Framework

Distant supervision for relation extraction enables one to effectively a...
research
02/09/2021

Bootstrapping Relation Extractors using Syntactic Search by Examples

The advent of neural-networks in NLP brought with it substantial improve...

Please sign up or login with your details

Forgot password? Click here to reset