Brain decoding from functional MRI using long short-term memory recurrent neural networks

09/14/2018
by   Hongming Li, et al.
0

Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain functional connectivity or brain activation signatures for a variety of brain decoding tasks. However, most of existing studies have built decoding models upon features extracted from imaging data at individual time points or temporal windows with a fixed interval, which might not be optimal across different cognitive processes due to varying temporal durations and dependency of different cognitive processes. In this study, we develop a deep learning based framework for brain decoding by leveraging recent advances in sequence modeling using long short-term memory (LSTM) recurrent neural networks (RNNs). Particularly, functional profiles extracted from task functional imaging data based on their corresponding subject-specific intrinsic functional networks are used as features to build brain decoding models, and LSTM RNNs are adopted to learn decoding mappings between functional profiles and brain states. We evaluate the proposed method using task fMRI data from the HCP dataset, and experimental results have demonstrated that the proposed method could effectively distinguish brain states under different task events and obtain higher accuracy than conventional decoding models.

READ FULL TEXT
research
09/14/2018

Identification of temporal transition of functional states using recurrent neural networks from functional MRI

Dynamic functional connectivity analysis provides valuable information f...
research
11/14/2022

High-Accuracy Machine Learning Techniques for Functional Connectome Fingerprinting and Cognitive State Decoding

The human brain is a complex network comprised of functionally and anato...
research
10/23/2018

Interpretable LSTMs For Whole-Brain Neuroimaging Analyses

The analysis of neuroimaging data poses several strong challenges, in pa...
research
08/30/2018

Deep Chronnectome Learning via Full Bidirectional Long Short-Term Memory Networks for MCI Diagnosis

Brain functional connectivity (FC) extracted from resting-state fMRI (RS...
research
11/17/2020

A Multi-Task Deep Learning Framework to Localize the Eloquent Cortex in Brain Tumor Patients Using Dynamic Functional Connectivity

We present a novel deep learning framework that uses dynamic functional ...
research
12/11/2020

Unsupervised deep learning for individualized brain functional network identification

A novel unsupervised deep learning method is developed to identify indiv...
research
10/14/2020

From Language to Language-ish: How Brain-Like is an LSTM's Representation of Nonsensical Language Stimuli?

The representations generated by many models of language (word embedding...

Please sign up or login with your details

Forgot password? Click here to reset