GATE: Graph CCA for Temporal SElf-supervised Learning for Label-efficient fMRI Analysis

03/17/2022
by   Liang Peng, et al.
10

In this work, we focus on the challenging task, neuro-disease classification, using functional magnetic resonance imaging (fMRI). In population graph-based disease analysis, graph convolutional neural networks (GCNs) have achieved remarkable success. However, these achievements are inseparable from abundant labeled data and sensitive to spurious signals. To improve fMRI representation learning and classification under a label-efficient setting, we propose a novel and theory-driven self-supervised learning (SSL) framework on GCNs, namely Graph CCA for Temporal self-supervised learning on fMRI analysis GATE. Concretely, it is demanding to design a suitable and effective SSL strategy to extract formation and robust features for fMRI. To this end, we investigate several new graph augmentation strategies from fMRI dynamic functional connectives (FC) for SSL training. Further, we leverage canonical-correlation analysis (CCA) on different temporal embeddings and present the theoretical implications. Consequently, this yields a novel two-step GCN learning procedure comprised of (i) SSL on an unlabeled fMRI population graph and (ii) fine-tuning on a small labeled fMRI dataset for a classification task. Our method is tested on two independent fMRI datasets, demonstrating superior performance on autism and dementia diagnosis.

READ FULL TEXT

page 1

page 3

research
12/16/2022

Toward Improved Generalization: Meta Transfer of Self-supervised Knowledge on Graphs

Despite the remarkable success achieved by graph convolutional networks ...
research
03/26/2022

Contrastive Graph Learning for Population-based fMRI Classification

Contrastive self-supervised learning has recently benefited fMRI classif...
research
06/28/2021

Understanding Cognitive Fatigue from fMRI Scans with Self-supervised Learning

Functional magnetic resonance imaging (fMRI) is a neuroimaging technique...
research
05/15/2023

Self-Supervised Pretraining on Paired Sequences of fMRI Data for Transfer Learning to Brain Decoding Tasks

In this work we introduce a self-supervised pretraining framework for tr...
research
11/16/2020

Temporal Dynamic Model for Resting State fMRI Data: A Neural Ordinary Differential Equation approach

The objective of this paper is to provide a temporal dynamic model for r...
research
12/06/2021

Learning Personal Representations from fMRIby Predicting Neurofeedback Performance

We present a deep neural network method for learning a personal represen...
research
12/10/2021

Pre-training and Fine-tuning Transformers for fMRI Prediction Tasks

We present the TFF Transformer framework for the analysis of functional ...

Please sign up or login with your details

Forgot password? Click here to reset