Decoding 3D Representation of Visual Imagery EEG using Attention-based Dual-Stream Convolutional Neural Network

12/14/2021
by   Hyung-Ju Ahn, et al.
0

A deep neural network has been successfully applied to an electroencephalogram (EEG)-based brain-computer interface. However, in most studies, the correlation between EEG channels and inter-region relationships are not well utilized, resulting in sub-optimized spatial feature extraction. In this study, we propose an attention-based dual-stream 3D-convolutional neural network that can enhance spatial feature extraction by emphasizing the relationship between channels with dot product-based channel attention and 3D convolution. The proposed method showed superior performance than the comparative models by achieving an accuracy of 0.58 for 4-class visual imagery (VI) EEG classification. Through statistical and neurophysiological analysis, visual motion imagery showed higher alpha-power spectral density (PSD) over the visual cortex than static VI. Also, the VI of swarm dispersion showed higher beta-PSD over the pre-frontal cortex than the VI of swarm aggregation.

READ FULL TEXT

page 2

page 4

research
10/21/2021

A channel attention based MLP-Mixer network for motor imagery decoding with EEG

Convolutional neural networks (CNNs) and their variants have been succes...
research
05/15/2020

Decoding of Intuitive Visual Motion Imagery Using Convolutional Neural Network under 3D-BCI Training Environment

In this study, we adopted visual motion imagery, which is a more intuiti...
research
12/03/2020

Cross-Correlation Based Discriminant Criterion for Channel Selection in Motor Imagery BCI Systems

Many electroencephalogram (EEG)-based brain-computer interface (BCI) sys...
research
03/05/2021

Low-latency auditory spatial attention detection based on spectro-spatial features from EEG

Detecting auditory attention based on brain signals enables many everyda...
research
02/04/2020

Spatio-Temporal Dynamics of Visual Imagery for Intuitive Brain-Computer Interface

Visual imagery is an intuitive brain-computer interface paradigm, referr...
research
11/24/2022

Channel Optimized Visual Imagery based Robotic Arm Control under the Online Environment

An electroencephalogram is an effective approach that provides a bidirec...
research
02/06/2021

Coherence of Working Memory Study Between Deep Neural Network and Neurophysiology

The auto feature extraction capability of deep neural networks (DNN) end...

Please sign up or login with your details

Forgot password? Click here to reset