DeepAI AI Chat
Log In Sign Up

Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networks

by   Ningyu Zhang, et al.

We propose a distance supervised relation extraction approach for long-tailed, imbalanced data which is prevalent in real-world settings. Here, the challenge is to learn accurate "few-shot" models for classes existing at the tail of the class distribution, for which little data is available. Inspired by the rich semantic correlations between classes at the long tail and those at the head, we take advantage of the knowledge from data-rich classes at the head of the distribution to boost the performance of the data-poor classes at the tail. First, we propose to leverage implicit relational knowledge among class labels from knowledge graph embeddings and learn explicit relational knowledge using graph convolution networks. Second, we integrate that relational knowledge into relation extraction model by coarse-to-fine knowledge-aware attention mechanism. We demonstrate our results for a large-scale benchmark dataset which show that our approach significantly outperforms other baselines, especially for long-tail relations.


page 1

page 2

page 3

page 4


Label-Aware Distribution Calibration for Long-tailed Classification

Real-world data usually present long-tailed distributions. Training on i...

MATT: A Multiple-instance Attention Mechanism for Long-tail Music Genre Classification

Imbalanced music genre classification is a crucial task in the Music Inf...

A Dataset for Hyper-Relational Extraction and a Cube-Filling Approach

Relation extraction has the potential for large-scale knowledge graph co...

Semantic Relation Reasoning for Shot-Stable Few-Shot Object Detection

Few-shot object detection is an imperative and long-lasting problem due ...

ELM: Embedding and Logit Margins for Long-Tail Learning

Long-tail learning is the problem of learning under skewed label distrib...

Learning to Segment the Tail

Real-world visual recognition requires handling the extreme sample imbal...

Document-level Relation Extraction with Relation Correlations

Document-level relation extraction faces two overlooked challenges: long...