Interpretable SincNet-based Deep Learning for Emotion Recognition from EEG brain activity

Machine learning methods, such as deep learning, show promising results in the medical domain. However, the lack of interpretability of these algorithms may hinder their applicability to medical decision support systems. This paper studies an interpretable deep learning technique, called SincNet. SincNet is a convolutional neural network that efficiently learns customized band-pass filters through trainable sinc-functions. In this study, we use SincNet to analyze the neural activity of individuals with Autism Spectrum Disorder (ASD), who experience characteristic differences in neural oscillatory activity. In particular, we propose a novel SincNet-based neural network for detecting emotions in ASD patients using EEG signals. The learned filters can be easily inspected to detect which part of the EEG spectrum is used for predicting emotions. We found that our system automatically learns the high-α (9-13 Hz) and β (13-30 Hz) band suppression often present in individuals with ASD. This result is consistent with recent neuroscience studies on emotion recognition, which found an association between these band suppressions and the behavioral deficits observed in individuals with ASD. The improved interpretability of SincNet is achieved without sacrificing performance in emotion recognition.

READ FULL TEXT

page 1

page 3

research
09/12/2018

Convolutional Neural Network Approach for EEG-based Emotion Recognition using Brain Connectivity and its Spatial Information

Emotion recognition based on electroencephalography (EEG) has received a...
research
11/25/2021

Evaluation of Interpretability for Deep Learning algorithms in EEG Emotion Recognition: A case study in Autism

Current models on Explainable Artificial Intelligence (XAI) have shown a...
research
09/26/2020

Cross-individual Recognition of Emotions by a Dynamic Entropy based on Pattern Learning with EEG features

Use of the electroencephalogram (EEG) and machine learning approaches to...
research
10/19/2021

EEGminer: Discovering Interpretable Features of Brain Activity with Learnable Filters

Patterns of brain activity are associated with different brain processes...
research
08/29/2017

Discovering Gender Differences in Facial Emotion Recognition via Implicit Behavioral Cues

We examine the utility of implicit behavioral cues in the form of EEG br...
research
03/16/2018

Decision support with text-based emotion recognition: Deep learning for affective computing

Emotions widely affect the decision-making of humans and, hence, affecti...
research
03/05/2021

Adaptive Gaussian Fuzzy Classifier for Real-Time Emotion Recognition in Computer Games

Human emotion recognition has become a need for more realistic and inter...

Please sign up or login with your details

Forgot password? Click here to reset