Modeling 4D fMRI Data via Spatio-Temporal Convolutional Neural Networks (ST-CNN)

by   Yu Zhao, et al.

Simultaneous modeling of the spatio-temporal variation patterns of brain functional network from 4D fMRI data has been an important yet challenging problem for the field of cognitive neuroscience and medical image analysis. Inspired by the recent success in applying deep learning for functional brain decoding and encoding, in this work we propose a spatio-temporal convolutional neural network (ST-CNN)to jointly learn the spatial and temporal patterns of targeted network from the training data and perform automatic, pin-pointing functional network identification. The proposed ST-CNN is evaluated by the task of identifying the Default Mode Network (DMN) from fMRI data. Results show that while the framework is only trained on one fMRI dataset,it has the sufficient generalizability to identify the DMN from different populations of data as well as different cognitive tasks. Further investigation into the results show that the superior performance of ST-CNN is driven by the jointly-learning scheme, which capture the intrinsic relationship between the spatial and temporal characteristic of DMN and ensures the accurate identification.



page 3

page 6

page 7

page 8

page 11

page 12


4D Spatio-Temporal Deep Learning with 4D fMRI Data for Autism Spectrum Disorder Classification

Autism spectrum disorder (ASD) is associated with behavioral and communi...

Disentangling Spatial-Temporal Functional Brain Networks via Twin-Transformers

How to identify and characterize functional brain networks (BN) is funda...

Attend and Decode: 4D fMRI Task State Decoding Using Attention Models

Functional magnetic resonance imaging (fMRI) is a neuroimaging modality ...

Learning Neural Markers of Schizophrenia Disorder Using Recurrent Neural Networks

Smart systems that can accurately diagnose patients with mental disorder...

A General Spatio-Temporal Clustering-Based Non-local Formulation for Multiscale Modeling of Compartmentalized Reservoirs

Representing the reservoir as a network of discrete compartments with ne...

Interpretable LSTMs For Whole-Brain Neuroimaging Analyses

The analysis of neuroimaging data poses several strong challenges, in pa...

Parameter clustering in Bayesian functional PCA of fMRI data

The extraordinary advancements in neuroscientific technology for brain r...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.