Palimpsest Memories Stored in Memristive Synapses

09/22/2021
by   Christos Giotis, et al.
0

Biological synapses store multiple memories on top of each other in a palimpsest fashion and at different timescales. Palimpsest consolidation is facilitated by the interaction of hidden biochemical processes that govern synaptic efficacy during varying lifetimes. This arrangement allows idle memories to be temporarily overwritten without being forgotten, in favour of new memories utilised in the short-term. While embedded artificial intelligence can greatly benefit from such functionality, a practical demonstration in hardware is still missing. Here, we show how the intrinsic properties of metal-oxide volatile memristors emulate the hidden processes that support biological palimpsest consolidation. Our memristive synapses exhibit an expanded doubled capacity which can protect a consolidated long-term memory while up to hundreds of uncorrelated short-term memories temporarily overwrite it. The synapses can also implement familiarity detection of previously forgotten memories. Crucially, palimpsest operation is achieved automatically and without the need for specialised instructions. We further demonstrate a practical adaptation of this technology in the context of image vision. This showcases the use of emerging memory technologies to efficiently expand the capacity of artificial intelligence hardware towards more generalised learning memories.

READ FULL TEXT

page 3

page 4

page 6

page 8

research
12/04/2021

Overcome Anterograde Forgetting with Cycled Memory Networks

Learning from a sequence of tasks for a lifetime is essential for an age...
research
02/09/2016

Associative Long Short-Term Memory

We investigate a new method to augment recurrent neural networks with ex...
research
02/04/2021

Adaptive Semiparametric Language Models

We present a language model that combines a large parametric neural netw...
research
02/17/2014

Does the D.C. Response of Memristors Allow Robotic Short-Term Memory and a Possible Route to Artificial Time Perception?

Time perception is essential for task switching, and in the mammalian br...
research
11/17/2022

Learning to Control Rapidly Changing Synaptic Connections: An Alternative Type of Memory in Sequence Processing Artificial Neural Networks

Short-term memory in standard, general-purpose, sequence-processing recu...
research
06/25/2021

Toward 6G: From New Hardware Design to Wireless Semantic and Goal-Oriented Communication Paradigms

Several speculative visions are conjecturing on what 6G services will be...
research
03/29/2022

Artificial Intelligence Software Structured to Simulate Human Working Memory, Mental Imagery, and Mental Continuity

This article presents an artificial intelligence (AI) architecture inten...

Please sign up or login with your details

Forgot password? Click here to reset