Forgetting Memories and their Attractiveness

05/31/2018
by   Enzo Marinari, et al.
0

We study numerically the memory which forgets, introduced in 1986 by Parisi by bounding the synaptic strength, with a mechanism which avoid confusion, allows to remember the pattern learned more recently and has a physiologically very well defined meaning. We analyze a number of features of the learning at finite number of neurons and finite number of patterns. We discuss how the system behaves in the large but finite N limit. We analyze the basin of attraction of the patterns that have been learned, and we show that it is exponentially small in the age of the pattern. This is a clearly non physiological feature of the model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/05/2013

A Non-Binary Associative Memory with Exponential Pattern Retrieval Capacity and Iterative Learning: Extended Results

We consider the problem of neural association for a network of non-binar...
research
02/01/2022

Content addressable memory without catastrophic forgetting by heteroassociation with a fixed scaffold

Content-addressable memory (CAM) networks, so-called because stored item...
research
10/29/2018

Dreaming neural networks: forgetting spurious memories and reinforcing pure ones

The standard Hopfield model for associative neural networks accounts for...
research
01/14/2019

The Complexity of Unavoidable Word Patterns

The avoidability, or unavoidability of patterns in words over finite alp...
research
02/21/2005

Learning intrinsic excitability in medium spiny neurons

We present an unsupervised, local activation-dependent learning rule for...
research
04/28/2023

The Exponential Capacity of Dense Associative Memories

Recent generalizations of the Hopfield model of associative memories are...
research
01/12/2012

Autonomous Cleaning of Corrupted Scanned Documents - A Generative Modeling Approach

We study the task of cleaning scanned text documents that are strongly c...

Please sign up or login with your details

Forgot password? Click here to reset