MEIM: Multi-partition Embedding Interaction Beyond Block Term Format for Efficient and Expressive Link Prediction

09/30/2022
by   Hung Nghiep Tran, et al.
0

Knowledge graph embedding aims to predict the missing relations between entities in knowledge graphs. Tensor-decomposition-based models, such as ComplEx, provide a good trade-off between efficiency and expressiveness, that is crucial because of the large size of real world knowledge graphs. The recent multi-partition embedding interaction (MEI) model subsumes these models by using the block term tensor format and provides a systematic solution for the trade-off. However, MEI has several drawbacks, some of which carried from its subsumed tensor-decomposition-based models. In this paper, we address these drawbacks and introduce the Multi-partition Embedding Interaction iMproved beyond block term format (MEIM) model, with independent core tensor for ensemble effects and soft orthogonality for max-rank mapping, in addition to multi-partition embedding. MEIM improves expressiveness while still being highly efficient, helping it to outperform strong baselines and achieve state-of-the-art results on difficult link prediction benchmarks using fairly small embedding sizes. The source code is released at https://github.com/tranhungnghiep/MEIM-KGE.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/29/2020

Multi-Partition Embedding Interaction with Block Term Format for Knowledge Graph Completion

Knowledge graph completion is an important task that aims to predict the...
research
11/16/2020

Tucker decomposition-based Temporal Knowledge Graph Completion

Knowledge graphs have been demonstrated to be an effective tool for nume...
research
02/08/2019

Knowledge Graph Fact Prediction via Knowledge-Enriched Tensor Factorization

We present a family of novel methods for embedding knowledge graphs into...
research
01/28/2019

TuckER: Tensor Factorization for Knowledge Graph Completion

Knowledge graphs are structured representations of real world facts. How...
research
07/03/2021

Trans4E: Link Prediction on Scholarly Knowledge Graphs

The incompleteness of Knowledge Graphs (KGs) is a crucial issue affectin...
research
03/27/2019

Analyzing Knowledge Graph Embedding Methods from a Multi-Embedding Interaction Perspective

Knowledge graph is a popular format for representing knowledge, with man...
research
04/22/2022

MEKER: Memory Efficient Knowledge Embedding Representation for Link Prediction and Question Answering

Knowledge Graphs (KGs) are symbolically structured storages of facts. Th...

Please sign up or login with your details

Forgot password? Click here to reset