Eigenvector Dreaming

08/09/2023
by   Marco Benedetti, et al.
0

Among the performance-enhancing procedures for Hopfield-type networks that implement associative memory, Hebbian Unlearning (or dreaming) strikes for its simplicity and its clear biological interpretation. Yet, it does not easily lend itself to a clear analytical understanding. Here we show how Hebbian Unlearning can be effectively described in terms of a simple evolution of the spectrum and the eigenvectors of the coupling matrix. We use these ideas to design new dreaming algorithms that are effective from a computational point of view, and are analytically far more transparent than the original scheme.

READ FULL TEXT
research
11/24/2022

ML Interpretability: Simple Isn't Easy

The interpretability of ML models is important, but it is not clear what...
research
02/03/2020

To pipeline or not to pipeline, that is the question

In designing query processing primitives, a crucial design choice is the...
research
09/11/2019

Discrete transparent boundary conditions for the two-dimensional leap-frog scheme

We develop a general strategy in order to implement (approximate) discre...
research
05/18/2015

Fractally-organized Connectionist Networks: Conjectures and Preliminary Results

A strict interpretation of connectionism mandates complex networks of si...
research
06/22/2023

Microscopic, kinetic and hydrodynamic hybrid models of collective motions with chemotaxis: a numerical study

A general class of hybrid models has been introduced recently, gathering...
research
02/12/2018

Design of Experiments for Model Discrimination Hybridising Analytical and Data-Driven Approaches

Healthcare companies must submit pharmaceutical drugs or medical devices...
research
08/01/2004

Why Two Sexes?

Evolutionary role of the separation into two sexes from a cyberneticist'...

Please sign up or login with your details

Forgot password? Click here to reset