Embedding Models for Episodic Memory

06/30/2018
by   Yunpu Ma, et al.
0

In recent years a number of large-scale triple-oriented knowledge graphs have been generated and various models have been proposed to perform learning in those graphs. Most knowledge graphs are static and reflect the world in its current state. In reality, of course, the state of the world is changing: a healthy person becomes diagnosed with a disease and a new president is inaugurated. In this paper, we extend models for static knowledge graphs to temporal knowledge graphs. This enables us to store episodic data and to generalize to new facts (inductive learning). We generalize leading learning models for static knowledge graphs (i.e., Tucker, RESCAL, HolE, ComplEx, DistMult) to temporal knowledge graphs. In particular, we introduce a new tensor model, ConT, with superior generalization performance. The performances of all proposed models are analyzed on two different datasets: the Global Database of Events, Language, and Tone (GDELT) and the database for Integrated Conflict Early Warning System (ICEWS). We argue that temporal knowledge graph embeddings might be models also for cognitive episodic memory (facts we remember and can recollect) and that a semantic memory (current facts we know) can be generated from episodic memory by a marginalization operation. We validate this episodic-to-semantic projection hypothesis with the ICEWS dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/29/2021

Leveraging Static Models for Link Prediction in Temporal Knowledge Graphs

The inclusion of temporal scopes of facts in knowledge graph embedding (...
research
11/25/2015

Learning with Memory Embeddings

Embedding learning, a.k.a. representation learning, has been shown to be...
research
04/17/2020

Duplication Detection in Knowledge Graphs: Literature and Tools

In recent years, an increasing amount of knowledge graphs (KGs) have bee...
research
11/28/2015

Column-Oriented Datalog Materialization for Large Knowledge Graphs (Extended Technical Report)

The evaluation of Datalog rules over large Knowledge Graphs (KGs) is ess...
research
10/21/2016

KGEval: Estimating Accuracy of Automatically Constructed Knowledge Graphs

Automatic construction of large knowledge graphs (KG) by mining web-scal...
research
08/16/2020

Efficient Knowledge Graph Validation via Cross-Graph Representation Learning

Recent advances in information extraction have motivated the automatic c...
research
01/29/2020

The Tensor Brain: Semantic Decoding for Perception and Memory

We analyse perception and memory using mathematical models for knowledge...

Please sign up or login with your details

Forgot password? Click here to reset