DeepAI AI Chat
Log In Sign Up

DyERNIE: Dynamic Evolution of Riemannian Manifold Embeddings for Temporal Knowledge Graph Completion

by   Zhen Han, et al.

There has recently been increasing interest in learning representations of temporal knowledge graphs (KGs), which record the dynamic relationships between entities over time. Temporal KGs often exhibit multiple simultaneous non-Euclidean structures, such as hierarchical and cyclic structures. However, existing embedding approaches for temporal KGs typically learn entity representations and their dynamic evolution in the Euclidean space, which might not capture such intrinsic structures very well. To this end, we propose Dy- ERNIE, a non-Euclidean embedding approach that learns evolving entity representations in a product of Riemannian manifolds, where the composed spaces are estimated from the sectional curvatures of underlying data. Product manifolds enable our approach to better reflect a wide variety of geometric structures on temporal KGs. Besides, to capture the evolutionary dynamics of temporal KGs, we let the entity representations evolve according to a velocity vector defined in the tangent space at each timestamp. We analyze in detail the contribution of geometric spaces to representation learning of temporal KGs and evaluate our model on temporal knowledge graph completion tasks. Extensive experiments on three real-world datasets demonstrate significantly improved performance, indicating that the dynamics of multi-relational graph data can be more properly modeled by the evolution of embeddings on Riemannian manifolds.


page 1

page 2

page 3

page 4


Improving Heterogeneous Graph Learning with Weighted Mixed-Curvature Product Manifold

In graph representation learning, it is important that the complex geome...

Conformal retrofitting via Riemannian manifolds: distilling task-specific graphs into pretrained embeddings

Pretrained (language) embeddings are versatile, task-agnostic feature re...

Know-Evolve: Deep Temporal Reasoning for Dynamic Knowledge Graphs

The availability of large scale event data with time stamps has given ri...

Symmetric Spaces for Graph Embeddings: A Finsler-Riemannian Approach

Learning faithful graph representations as sets of vertex embeddings has...

Pseudo-Riemannian Embedding Models for Multi-Relational Graph Representations

In this paper we generalize single-relation pseudo-Riemannian graph embe...

FMGNN: Fused Manifold Graph Neural Network

Graph representation learning has been widely studied and demonstrated e...

GTRL: An Entity Group-Aware Temporal Knowledge Graph Representation Learning Method

Temporal Knowledge Graph (TKG) representation learning embeds entities a...