A New Training Algorithm for Kanerva's Sparse Distributed Memory

07/22/2012
by   Lou Marvin Caraig, et al.
0

The Sparse Distributed Memory proposed by Pentii Kanerva (SDM in short) was thought to be a model of human long term memory. The architecture of the SDM permits to store binary patterns and to retrieve them using partially matching patterns. However Kanerva's model is especially efficient only in handling random data. The purpose of this article is to introduce a new approach of training Kanerva's SDM that can handle efficiently non-random data, and to provide it the capability to recognize inverted patterns. This approach uses a signal model which is different from the one proposed for different purposes by Hely, Willshaw and Hayes in [4]. This article additionally suggests a different way of creating hard locations in the memory despite the Kanerva's static model.

READ FULL TEXT
research
11/03/2021

Graph Tree Memory Networks

We introduce Graph Tree Memory Networks that memorize and remember any d...
research
07/06/2023

RecallM: An Architecture for Temporal Context Understanding and Question Answering

The ideal long-term memory mechanism for Large Language Model (LLM) base...
research
07/31/2023

MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

Recently, integrating video foundation models and large language models ...
research
12/30/2022

Long-Term Online Multi-Session Graph-Based SPLAM with Memory Management

For long-term simultaneous planning, localization and mapping (SPLAM), a...
research
08/19/2022

Kernel Memory Networks: A Unifying Framework for Memory Modeling

We consider the problem of training a neural network to store a set of p...
research
02/18/2020

Compact Merkle Multiproofs

The compact Merkle multiproof is a new and significantly more memory-eff...
research
01/09/2020

Online Memorization of Random Firing Sequences by a Recurrent Neural Network

This paper studies the capability of a recurrent neural network model to...

Please sign up or login with your details

Forgot password? Click here to reset