KGCleaner : Identifying and Correcting Errors Produced by Information Extraction Systems

by   Ankur Padia, et al.

KGCleaner is a framework to identify and correct errors in data produced and delivered by an information extraction system. These tasks have been understudied and KGCleaner is the first to address both. We introduce a multi-task model that jointly learns to predict if an extracted relation is credible and repair it if not. We evaluate our approach and other models as instance of our framework on two collections: a Wikidata corpus of nearly 700K facts and 5M fact-relevant sentences and a collection of 30K facts from the 2015 TAC Knowledge Base Population task. For credibility classification, parameter efficient simple shallow neural network can achieve an absolute performance gain of 30 F_1 points on Wikidata and comparable performance on TAC. For the repair task, significant performance (at more than twice) gain can be obtained depending on the nature of the dataset and the models.


page 1

page 2

page 3

page 4


Do Embedding Models Perform Well for Knowledge Base Completion?

In this work, we put into question the effectiveness of the evaluation m...

Fact Discovery from Knowledge Base via Facet Decomposition

During the past few decades, knowledge bases (KBs) have experienced rapi...

Tokenization Repair in the Presence of Spelling Errors

We consider the following tokenization repair problem: Given a natural l...

Distantly Supervised Relation Extraction with Sentence Reconstruction and Knowledge Base Priors

We propose a multi-task, probabilistic approach to facilitate distantly ...

Open Information Extraction from Question-Answer Pairs

Open Information Extraction (OpenIE) extracts meaningful structured tupl...

MedFilter: Improving Extraction of Task-relevant Utterances through Integration of Discourse Structure and Ontological Knowledge

Information extraction from conversational data is particularly challeng...

Dynamic Relation Repairing for Knowledge Enhancement

Dynamic relation repair aims to efficiently validate and repair the inst...