EEGFuseNet: Hybrid Unsupervised Deep Feature Characterization and Fusion for High-Dimensional EEG with An Application to Emotion Recognition

02/07/2021
by   Zhen Liang, et al.
13

How to effectively and efficiently extract valid and reliable features from high-dimensional electroencephalography (EEG), particularly how to fuse the spatial and temporal dynamic brain information into a better feature representation, is a critical issue in brain data analysis. Most current EEG studies are working on handcrafted features with a supervised modeling, which would be limited by experience and human feedbacks to a great extent. In this paper, we propose a practical hybrid unsupervised deep CNN-RNN-GAN based EEG feature characterization and fusion model, which is termed as EEGFuseNet. EEGFuseNet is trained in an unsupervised manner, and deep EEG features covering spatial and temporal dynamics are automatically characterized. Comparing to the handcrafted features, the deep EEG features could be considered to be more generic and independent of any specific EEG task. The performance of the extracted deep and low-dimensional features by EEGFuseNet is carefully evaluated in an unsupervised emotion recognition application based on a famous public emotion database. The results demonstrate the proposed EEGFuseNet is a robust and reliable model, which is easy to train and manage and perform efficiently in the representation and fusion of dynamic EEG features. In particular, EEGFuseNet is established as an optimal unsupervised fusion model with promising subject-based leave-one-out results in the recognition of four emotion dimensions (valence, arousal, dominance and liking), which demonstrates the possibility of realizing EEG based cross-subject emotion recognition in a pure unsupervised manner.

READ FULL TEXT

page 18

page 28

page 29

research
05/27/2023

Inter Subject Emotion Recognition Using Spatio-Temporal Features From EEG Signal

Inter-subject or subject-independent emotion recognition has been a chal...
research
04/09/2021

SFE-Net: EEG-based Emotion Recognition with Symmetrical Spatial Feature Extraction

Emotion recognition based on EEG (electroencephalography) has been widel...
research
09/12/2018

Convolutional Neural Network Approach for EEG-based Emotion Recognition using Brain Connectivity and its Spatial Information

Emotion recognition based on electroencephalography (EEG) has received a...
research
10/22/2019

Spatiotemporal Emotion Recognition using Deep CNN Based on EEG during Music Listening

Emotion recognition based on EEG has become an active research area. As ...
research
09/26/2020

Cross-individual Recognition of Emotions by a Dynamic Entropy based on Pattern Learning with EEG features

Use of the electroencephalogram (EEG) and machine learning approaches to...
research
04/07/2021

TSception: Capturing Temporal Dynamics and Spatial Asymmetry from EEG for Emotion Recognition

In this paper, we propose TSception, a multi-scale convolutional neural ...
research
05/12/2023

A Lightweight Domain Adversarial Neural Network Based on Knowledge Distillation for EEG-based Cross-subject Emotion Recognition

Individual differences of Electroencephalogram (EEG) could cause the dom...

Please sign up or login with your details

Forgot password? Click here to reset