Multi-Level Error-Resilient Neural Networks with Learning

02/13/2012
by   Amir Hesam Salavati, et al.
0

The problem of neural network association is to retrieve a previously memorized pattern from its noisy version using a network of neurons. An ideal neural network should include three components simultaneously: a learning algorithm, a large pattern retrieval capacity and resilience against noise. Prior works in this area usually improve one or two aspects at the cost of the third. Our work takes a step forward in closing this gap. More specifically, we show that by forcing natural constraints on the set of learning patterns, we can drastically improve the retrieval capacity of our neural network. Moreover, we devise a learning algorithm whose role is to learn those patterns satisfying the above mentioned constraints. Finally we show that our neural network can cope with a fair amount of noise.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/24/2014

Convolutional Neural Associative Memories: Massive Capacity with Noise Tolerance

The task of a neural associative memory is to retrieve a set of previous...
research
02/05/2013

A Non-Binary Associative Memory with Exponential Pattern Retrieval Capacity and Iterative Learning: Extended Results

We consider the problem of neural association for a network of non-binar...
research
07/02/2010

Delta Learning Rule for the Active Sites Model

This paper reports the results on methods of comparing the memory retrie...
research
04/05/2022

Cross-Frequency Coupling Increases Memory Capacity in Oscillatory Neural Networks

An open problem in neuroscience is to explain the functional role of osc...
research
10/16/2020

The Capacity of Symmetric Private Information Retrieval under Arbitrary Collusion and Eavesdropping Patterns

We study the symmetric private information retrieval (SPIR) problem unde...
research
01/26/2013

Neural Networks Built from Unreliable Components

Recent advances in associative memory design through strutured pattern s...
research
06/17/2021

Exploring the Properties and Evolution of Neural Network Eigenspaces during Training

In this work we explore the information processing inside neural network...

Please sign up or login with your details

Forgot password? Click here to reset