Transfer learning to decode brain states reflecting the relationship between cognitive tasks

06/07/2022
by   Youzhi Qu, et al.
0

Transfer learning improves the performance of the target task by leveraging the data of a specific source task: the closer the relationship between the source and the target tasks, the greater the performance improvement by transfer learning. In neuroscience, the relationship between cognitive tasks is usually represented by similarity of activated brain regions or neural representation. However, no study has linked transfer learning and neuroscience to reveal the relationship between cognitive tasks. In this study, we propose a transfer learning framework to reflect the relationship between cognitive tasks, and compare the task relations reflected by transfer learning and by the overlaps of brain regions (e.g., neurosynth). Our results of transfer learning create cognitive taskonomy to reflect the relationship between cognitive tasks which is well in line with the task relations derived from neurosynth. Transfer learning performs better in task decoding with fMRI data if the source and target cognitive tasks activate similar brain regions. Our study uncovers the relationship of multiple cognitive tasks and provides guidance for source task selection in transfer learning for neural decoding based on small-sample data.

READ FULL TEXT

page 4

page 5

research
03/26/2019

Domain Independent SVM for Transfer Learning in Brain Decoding

Brain imaging data are important in brain sciences yet expensive to obta...
research
07/07/2020

The curious case of developmental BERTology: On sparsity, transfer learning, generalization and the brain

In this essay, we explore a point of intersection between deep learning ...
research
10/03/2021

Attention module improves both performance and interpretability of 4D fMRI decoding neural network

Decoding brain cognitive states from neuroimaging signals is an importan...
research
09/07/2012

On spatial selectivity and prediction across conditions with fMRI

Researchers in functional neuroimaging mostly use activation coordinates...
research
08/16/2021

Challenges for cognitive decoding using deep learning methods

In cognitive decoding, researchers aim to characterize a brain region's ...
research
09/19/2022

On the benefits of self-taught learning for brain decoding

We study the benefits of using a large public neuroimaging database comp...
research
06/11/2020

Blissful Ignorance: Anti-Transfer Learning for Task Invariance

We introduce the novel concept of anti-transfer learning for neural netw...

Please sign up or login with your details

Forgot password? Click here to reset