Evaluation of Interpretability for Deep Learning algorithms in EEG Emotion Recognition: A case study in Autism

11/25/2021
by   Juan Manuel Mayor-Torres, et al.
0

Current models on Explainable Artificial Intelligence (XAI) have shown an evident and quantified lack of reliability for measuring feature-relevance when statistically entangled features are proposed for training deep classifiers. There has been an increase in the application of Deep Learning in clinical trials to predict early diagnosis of neuro-developmental disorders, such as Autism Spectrum Disorder (ASD). However, the inclusion of more reliable saliency-maps to obtain more trustworthy and interpretable metrics using neural activity features is still insufficiently mature for practical applications in diagnostics or clinical trials. Moreover, in ASD research the inclusion of deep classifiers that use neural measures to predict viewed facial emotions is relatively unexplored. Therefore, in this study we propose the evaluation of a Convolutional Neural Network (CNN) for electroencephalography (EEG)-based facial emotion recognition decoding complemented with a novel RemOve-And-Retrain (ROAR) methodology to recover highly relevant features used in the classifier. Specifically, we compare well-known relevance maps such as Layer-Wise Relevance Propagation (LRP), PatternNet, Pattern Attribution, and Smooth-Grad Squared. This study is the first to consolidate a more transparent feature-relevance calculation for a successful EEG-based facial emotion recognition using a within-subject-trained CNN in typically-developed and ASD individuals.

READ FULL TEXT

page 5

page 8

page 12

research
07/18/2021

Interpretable SincNet-based Deep Learning for Emotion Recognition from EEG brain activity

Machine learning methods, such as deep learning, show promising results ...
research
09/12/2018

Convolutional Neural Network Approach for EEG-based Emotion Recognition using Brain Connectivity and its Spatial Information

Emotion recognition based on electroencephalography (EEG) has received a...
research
05/07/2023

CIT-EmotionNet: CNN Interactive Transformer Network for EEG Emotion Recognition

Emotion recognition using Electroencephalogram (EEG) signals has emerged...
research
01/10/2016

Identifying Stable Patterns over Time for Emotion Recognition from EEG

In this paper, we investigate stable patterns of electroencephalogram (E...
research
06/19/2020

Emotion Recognition on large video dataset based on Convolutional Feature Extractor and Recurrent Neural Network

For many years, the emotion recognition task has remained one of the mos...
research
09/26/2020

Cross-individual Recognition of Emotions by a Dynamic Entropy based on Pattern Learning with EEG features

Use of the electroencephalogram (EEG) and machine learning approaches to...
research
11/19/2018

Unsupervised Learning in Reservoir Computing for EEG-based Emotion Recognition

In real-world applications such as emotion recognition from recorded bra...

Please sign up or login with your details

Forgot password? Click here to reset