DeepAI
Log In Sign Up

Low-Dimensional Hyperbolic Knowledge Graph Embeddings

05/01/2020
by   Ines Chami, et al.
10

Knowledge graph (KG) embeddings learn low-dimensional representations of entities and relations to predict missing facts. KGs often exhibit hierarchical and logical patterns which must be preserved in the embedding space. For hierarchical data, hyperbolic embedding methods have shown promise for high-fidelity and parsimonious representations. However, existing hyperbolic embedding methods do not account for the rich logical patterns in KGs. In this work, we introduce a class of hyperbolic KG embedding models that simultaneously capture hierarchical and logical patterns. Our approach combines hyperbolic reflections and rotations with attention to model complex relational patterns. Experimental results on standard KG benchmarks show that our method improves over previous Euclidean- and hyperbolic-based efforts by up to 6.1 mean reciprocal rank (MRR) in low dimensions. Furthermore, we observe that different geometric transformations capture different types of relations while attention-based transformations generalize to multiple relations. In high dimensions, our approach yields new state-of-the-art MRRs of 49.6 and 57.7

READ FULL TEXT

page 1

page 2

page 3

page 4

04/28/2022

Hyperbolic Hierarchical Knowledge Graph Embeddings for Link Prediction in Low Dimensions

Knowledge graph embeddings (KGE) have been validated as powerful methods...
11/07/2022

Complex Hyperbolic Knowledge Graph Embeddings with Fast Fourier Transform

The choice of geometric space for knowledge graph (KG) embeddings can ha...
10/28/2021

Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones

Hierarchical relations are prevalent and indispensable for organizing hu...
06/24/2022

Geometry Interaction Knowledge Graph Embeddings

Knowledge graph (KG) embeddings have shown great power in learning repre...
03/27/2021

High-efficiency Euclidean-based Models for Low-dimensional Knowledge Graph Embeddings

Recent knowledge graph embedding (KGE) models based on hyperbolic geomet...
09/29/2021

BiQUE: Biquaternionic Embeddings of Knowledge Graphs

Knowledge graph embeddings (KGEs) compactly encode multi-relational know...
02/03/2019

Inferring Concept Hierarchies from Text Corpora via Hyperbolic Embeddings

We consider the task of inferring is-a relationships from large text cor...

Code Repositories

KGEmb

Hyperbolic Knowledge Graph embeddings.


view repo