fMRI-S4: learning short- and long-range dynamic fMRI dependencies using 1D Convolutions and State Space Models

08/08/2022
by   Ahmed El Gazzar, et al.
0

Single-subject mapping of resting-state brain functional activity to non-imaging phenotypes is a major goal of neuroimaging. The large majority of learning approaches applied today rely either on static representations or on short-term temporal correlations. This is at odds with the nature of brain activity which is dynamic and exhibit both short- and long-range dependencies. Further, new sophisticated deep learning approaches have been developed and validated on single tasks/datasets. The application of these models for the study of a different targets typically require exhaustive hyperparameter search, model engineering and trial and error to obtain competitive results with simpler linear models. This in turn limit their adoption and hinder fair benchmarking in a rapidly developing area of research. To this end, we propose fMRI-S4; a versatile deep learning model for the classification of phenotypes and psychiatric disorders from the timecourses of resting-state functional magnetic resonance imaging scans. fMRI-S4 capture short- and long- range temporal dependencies in the signal using 1D convolutions and the recently introduced state-space models S4. The proposed architecture is lightweight, sample-efficient and robust across tasks/datasets. We validate fMRI-S4 on the tasks of diagnosing major depressive disorder (MDD), autism spectrum disorder (ASD) and sex classifcation on three multi-site rs-fMRI datasets. We show that fMRI-S4 can outperform existing methods on all three tasks and can be trained as a plug play model without special hyperpararameter tuning for each setting

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/07/2022

Improving the Diagnosis of Psychiatric Disorders with Self-Supervised Graph State Space Models

Single subject prediction of brain disorders from neuroimaging data has ...
research
04/01/2020

Mapping individual differences in cortical architecture using multi-view representation learning

In neuroscience, understanding inter-individual differences has recently...
research
10/11/2022

Multi-site Diagnostic Classification Of Schizophrenia Using 3D CNN On Aggregated Task-based fMRI Data

In spite of years of research, the mechanisms that underlie the developm...
research
04/04/2022

Long Movie Clip Classification with State-Space Video Models

Most modern video recognition models are designed to operate on short vi...
research
02/14/2020

A Hybrid 3DCNN and 3DC-LSTM based model for 4D Spatio-temporal fMRI data: An ABIDE Autism Classification study

Functional Magnetic Resonance Imaging (fMRI) captures the temporal dynam...
research
11/16/2020

Temporal Dynamic Model for Resting State fMRI Data: A Neural Ordinary Differential Equation approach

The objective of this paper is to provide a temporal dynamic model for r...
research
06/18/2019

TempoCave: Visualizing Dynamic Connectome Datasets to Support Cognitive Behavioral Therapy

We introduce TempoCave, a novel visualization application for analyzing ...

Please sign up or login with your details

Forgot password? Click here to reset