DeepAI AI Chat
Log In Sign Up

Posterior-regularized REINFORCE for Instance Selection in Distant Supervision

by   Qi Zhang, et al.
University of Southern California
Zhejiang University

This paper provides a new way to improve the efficiency of the REINFORCE training process. We apply it to the task of instance selection in distant supervision. Modeling the instance selection in one bag as a sequential decision process, a reinforcement learning agent is trained to determine whether an instance is valuable or not and construct a new bag with less noisy instances. However unbiased methods, such as REINFORCE, could usually take much time to train. This paper adopts posterior regularization (PR) to integrate some domain-specific rules in instance selection using REINFORCE. As the experiment results show, this method remarkably improves the performance of the relation classifier trained on cleaned distant supervision dataset as well as the efficiency of the REINFORCE training.


page 1

page 2

page 3

page 4


Reinforcement Learning for Relation Classification from Noisy Data

Existing relation classification methods that rely on distant supervisio...

SENT: Sentence-level Distant Relation Extraction via Negative Training

Distant supervision for relation extraction provides uniform bag labels ...

A Survey of Distant Supervision Methods using PGMs

Relation Extraction refers to the task of populating a database with tup...

DSGAN: Generative Adversarial Training for Distant Supervision Relation Extraction

Distant supervision can effectively label data for relation extraction, ...

Improving distant supervision using inference learning

Distant supervision is a widely applied approach to automatic training o...

Active Reinforcement Learning over MDPs

The past decade has seen the rapid development of Reinforcement Learning...

Distant Supervision from Disparate Sources for Low-Resource Part-of-Speech Tagging

We introduce DsDs: a cross-lingual neural part-of-speech tagger that lea...

Code Repositories


source code for Posterior-regularized REINFORCE for Instance Selection in Distant Supervision

view repo