DeepAI AI Chat
Log In Sign Up

Knowledgebra: An Algebraic Learning Framework for Knowledge Graph

by   Tong Yang, et al.

Knowledge graph (KG) representation learning aims to encode entities and relations into dense continuous vector spaces such that knowledge contained in a dataset could be consistently represented. Dense embeddings trained from KG datasets benefit a variety of downstream tasks such as KG completion and link prediction. However, existing KG embedding methods fell short to provide a systematic solution for the global consistency of knowledge representation. We developed a mathematical language for KG based on an observation of their inherent algebraic structure, which we termed as Knowledgebra. By analyzing five distinct algebraic properties, we proved that the semigroup is the most reasonable algebraic structure for the relation embedding of a general knowledge graph. We implemented an instantiation model, SemE, using simple matrix semigroups, which exhibits state-of-the-art performance on standard datasets. Moreover, we proposed a regularization-based method to integrate chain-like logic rules derived from human knowledge into embedding training, which further demonstrates the power of the developed language. As far as we know, by applying abstract algebra in statistical learning, this work develops the first formal language for general knowledge graphs, and also sheds light on the problem of neural-symbolic integration from an algebraic perspective.


page 1

page 2

page 3

page 4


Knowledge Graph Embedding: A Survey from the Perspective of Representation Spaces

Knowledge graph embedding (KGE) is a increasingly popular technique that...

Geometric Algebra based Embeddings for Static and Temporal Knowledge Graph Completion

Recent years, Knowledge Graph Embeddings (KGEs) have shown promising per...

From One Point to A Manifold: Knowledge Graph Embedding For Precise Link Prediction

Knowledge graph embedding aims at offering a numerical knowledge represe...

Data Considerations in Graph Representation Learning for Supply Chain Networks

Supply chain network data is a valuable asset for businesses wishing to ...

The DLCC Node Classification Benchmark for Analyzing Knowledge Graph Embeddings

Knowledge graph embedding is a representation learning technique that pr...

Semantic Embeddings in Semilattices

To represent anything from mathematical concepts to real-world objects, ...

Algebraic Learning: Towards Interpretable Information Modeling

Along with the proliferation of digital data collected using sensor tech...