Metaplasticity in Multistate Memristor Synaptic Networks

02/26/2020
by   Fatima Tuz Zohora, et al.
0

Recent studies have shown that metaplastic synapses can retain information longer than simple binary synapses and are beneficial for continual learning. In this paper, we explore the multistate metaplastic synapse characteristics in the context of high retention and reception of information. Inherent behavior of a memristor emulating the multistate synapse is employed to capture the metaplastic behavior. An integrated neural network study for learning and memory retention is performed by integrating the synapse in a 5×3 crossbar at the circuit level and 128×128 network at the architectural level. An on-device training circuitry ensures the dynamic learning in the network. In the 128×128 network, it is observed that the number of input patterns the multistate synapse can classify is ≃ 2.1x that of a simple binary synapse model, at a mean accuracy of ≥ 75

READ FULL TEXT
research
04/05/2019

Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning

Models trained in the context of continual learning (CL) should be able ...
research
06/27/2022

On-device Synaptic Memory Consolidation using Fowler-Nordheim Quantum-tunneling

Synaptic memory consolidation has been heralded as one of the key mechan...
research
06/08/2022

SYNERgy between SYNaptic consolidation and Experience Replay for general continual learning

Continual learning (CL) in the brain is facilitated by a complex set of ...
research
09/09/2019

Efficient Continual Learning in Neural Networks with Embedding Regularization

Continual learning of deep neural networks is a key requirement for scal...
research
06/22/2023

Learnability and Algorithm for Continual Learning

This paper studies the challenging continual learning (CL) setting of Cl...

Please sign up or login with your details

Forgot password? Click here to reset