The Tensor Memory Hypothesis

by   Volker Tresp, et al.

We discuss memory models which are based on tensor decompositions using latent representations of entities and events. We show how episodic memory and semantic memory can be realized and discuss how new memory traces can be generated from sensory input: Existing memories are the basis for perception and new memories are generated via perception. We relate our mathematical approach to the hippocampal memory indexing theory. We describe the first detailed mathematical models for the complete processing pipeline from sensory input and its semantic decoding, i.e., perception, to the formation of episodic and semantic memories and their declarative semantic decodings. Our main hypothesis is that perception includes an active semantic decoding process, which relies on latent representations of entities and predicates, and that episodic and semantic memories depend on the same decoding process. We contribute to the debate between the leading memory consolidation theories, i.e., the standard consolidation theory (SCT) and the multiple trace theory (MTT). The latter is closely related to the complementary learning systems (CLS) framework. In particular, we show explicitly how episodic memory can teach the neocortex to form a semantic memory, which is a core issue in MTT and CLS.


page 1

page 2

page 3

page 4


Learning with Memory Embeddings

Embedding learning, a.k.a. representation learning, has been shown to be...

RTOP: A Conceptual and Computational Framework for General Intelligence

A novel general intelligence model is proposed with three types of learn...

The Tensor Brain: Semantic Decoding for Perception and Memory

We analyse perception and memory using mathematical models for knowledge...

The Tensor Brain: A Unified Theory of Perception, Memory and Semantic Decoding

We present a unified computational theory of perception and memory. In o...

From seeing to remembering: Images with harder-to-reconstruct representations leave stronger memory traces

Much of what we remember is not due to intentional selection, but simply...

Kanerva++: extending The Kanerva Machine with differentiable, locally block allocated latent memory

Episodic and semantic memory are critical components of the human memory...

A model of semantic completion in generative episodic memory

Many different studies have suggested that episodic memory is a generati...

Please sign up or login with your details

Forgot password? Click here to reset