Bridging LSTM Architecture and the Neural Dynamics during Reading

04/22/2016
by   Peng Qian, et al.
0

Recently, the long short-term memory neural network (LSTM) has attracted wide interest due to its success in many tasks. LSTM architecture consists of a memory cell and three gates, which looks similar to the neuronal networks in the brain. However, there still lacks the evidence of the cognitive plausibility of LSTM architecture as well as its working mechanism. In this paper, we study the cognitive plausibility of LSTM by aligning its internal architecture with the brain activity observed via fMRI when the subjects read a story. Experiment results show that the artificial memory vector in LSTM can accurately predict the observed sequential brain activities, indicating the correlation between LSTM architecture and the cognitive process of story reading.

READ FULL TEXT
research
05/06/2016

LSTM with Working Memory

Previous RNN architectures have largely been superseded by LSTM, or "Lon...
research
10/14/2020

From Language to Language-ish: How Brain-Like is an LSTM's Representation of Nonsensical Language Stimuli?

The representations generated by many models of language (word embedding...
research
09/10/2017

Cognitive networks: brains, internet, and civilizations

In this short essay, we discuss some basic features of cognitive activit...
research
10/23/2018

Interpretable LSTMs For Whole-Brain Neuroimaging Analyses

The analysis of neuroimaging data poses several strong challenges, in pa...
research
01/20/2023

Self-Organization Towards 1/f Noise in Deep Neural Networks

Despite 1/f noise being ubiquitous in both natural and artificial system...
research
06/01/2022

Binding Dancers Into Attractors

To effectively perceive and process observations in our environment, fea...

Please sign up or login with your details

Forgot password? Click here to reset