Knowledge Graph Embedding with Iterative Guidance from Soft Rules

11/30/2017
by   Shu Guo, et al.
0

Embedding knowledge graphs (KGs) into continuous vector spaces is a focus of current research. Combining such an embedding model with logic rules has recently attracted increasing attention. Most previous attempts made a one-time injection of logic rules, ignoring the interactive nature between embedding learning and logical inference. And they focused only on hard rules, which always hold with no exception and usually require extensive manual effort to create or validate. In this paper, we propose Rule-Guided Embedding (RUGE), a novel paradigm of KG embedding with iterative guidance from soft rules. RUGE enables an embedding model to learn simultaneously from 1) labeled triples that have been directly observed in a given KG, 2) unlabeled triples whose labels are going to be predicted iteratively, and 3) soft rules with various confidence levels extracted automatically from the KG. In the learning process, RUGE iteratively queries rules to obtain soft labels for unlabeled triples, and integrates such newly labeled triples to update the embedding model. Through this iterative procedure, knowledge embodied in logic rules may be better transferred into the learned embeddings. We evaluate RUGE in link prediction on Freebase and YAGO. Experimental results show that: 1) with rule knowledge injected iteratively, RUGE achieves significant and consistent improvements over state-of-the-art baselines; and 2) despite their uncertainties, automatically extracted soft rules are highly beneficial to KG embedding, even those with moderate confidence levels. The code and data used for this paper can be obtained from https://github.com/iieir-km/RUGE.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/24/2022

RulE: Neural-Symbolic Knowledge Graph Reasoning with Rule Embedding

Knowledge graph (KG) reasoning is an important problem for knowledge gra...
research
03/09/2019

Logic Rules Powered Knowledge Graph Embedding

Large scale knowledge graph embedding has attracted much attention from ...
research
05/17/2023

Iteratively Learning Representations for Unseen Entities with Inter-Rule Correlations

Recent work on knowledge graph completion (KGC) focused on learning embe...
research
11/14/2020

Association Rules Enhanced Knowledge Graph Attention Network

Most existing knowledge graphs suffer from incompleteness. Embedding kno...
research
01/07/2023

Knowledge Reasoning via Jointly Modeling Knowledge Graphs and Soft Rules

Knowledge graphs (KGs) play a crucial role in many applications, such as...
research
11/20/2019

Rule-Guided Compositional Representation Learning on Knowledge Graphs

Representation learning on a knowledge graph (KG) is to embed entities a...
research
11/30/2022

Logic and Commonsense-Guided Temporal Knowledge Graph Completion

A temporal knowledge graph (TKG) stores the events derived from the data...

Please sign up or login with your details

Forgot password? Click here to reset