DeepAI AI Chat
Log In Sign Up

Emotional Brain State Classification on fMRI Data Using Deep Residual and Convolutional Networks

by   Maxime Tchibozo, et al.

The goal of emotional brain state classification on functional MRI (fMRI) data is to recognize brain activity patterns related to specific emotion tasks performed by subjects during an experiment. Distinguishing emotional brain states from other brain states using fMRI data has proven to be challenging due to two factors: a difficulty to generate fast yet accurate predictions in short time frames, and a difficulty to extract emotion features which generalize to unseen subjects. To address these challenges, we conducted an experiment in which 22 subjects viewed pictures designed to stimulate either negative, neutral or rest emotional responses while their brain activity was measured using fMRI. We then developed two distinct Convolution-based approaches to decode emotional brain states using only spatial information from single, minimally pre-processed (slice timing and realignment) fMRI volumes. In our first approach, we trained a 1D Convolutional Network (84.9 level 33 (ANOVA) voxel selection combined with hyperalignment. In our second approach, we trained a 3D ResNet-50 model (78.0 2 emotion conditions from single 3D fMRI volumes directly. Our Convolutional and Residual classifiers successfully learned group-level emotion features and could decode emotion conditions from fMRI volumes in milliseconds. These approaches could potentially be used in brain computer interfaces and real-time fMRI neurofeedback research.


page 1

page 2

page 3

page 4


Generating fMRI volumes from T1-weighted volumes using 3D CycleGAN

Registration between an fMRI volume and a T1-weighted volume is challeng...

Multi-view Multi-label Fine-grained Emotion Decoding from Human Brain Activity

Decoding emotional states from human brain activity plays an important r...

Effective and Interpretable fMRI Analysis via Functional Brain Network Generation

Recent studies in neuroscience show great potential of functional brain ...

A Hierarchical Graphical Model for Big Inverse Covariance Estimation with an Application to fMRI

Brain networks has attracted the interests of many neuroscientists. From...

Learning Deep Temporal Representations for Brain Decoding

Functional magnetic resonance imaging produces high dimensional data, wi...

Uncovering the Topology of Time-Varying fMRI Data using Cubical Persistence

Functional magnetic resonance imaging (fMRI) is a crucial technology for...

fMRI Neurofeedback Learning Patterns are Predictive of Personal and Clinical Traits

We obtain a personal signature of a person's learning progress in a self...