DGSD: Dynamical Graph Self-Distillation for EEG-Based Auditory Spatial Attention Detection

09/07/2023
by   Cunhang Fan, et al.
0

Auditory Attention Detection (AAD) aims to detect target speaker from brain signals in a multi-speaker environment. Although EEG-based AAD methods have shown promising results in recent years, current approaches primarily rely on traditional convolutional neural network designed for processing Euclidean data like images. This makes it challenging to handle EEG signals, which possess non-Euclidean characteristics. In order to address this problem, this paper proposes a dynamical graph self-distillation (DGSD) approach for AAD, which does not require speech stimuli as input. Specifically, to effectively represent the non-Euclidean properties of EEG signals, dynamical graph convolutional networks are applied to represent the graph structure of EEG signals, which can also extract crucial features related to auditory spatial attention in EEG signals. In addition, to further improve AAD detection performance, self-distillation, consisting of feature distillation and hierarchical distillation strategies at each layer, is integrated. These strategies leverage features and classification results from the deepest network layers to guide the learning of shallow layers. Our experiments are conducted on two publicly available datasets, KUL and DTU. Under a 1-second time window, we achieve results of 90.0% and 79.6% accuracy on KUL and DTU, respectively. We compare our DGSD method with competitive baselines, and the experimental results indicate that the detection performance of our proposed DGSD method is not only superior to the best reproducible baseline but also significantly reduces the number of trainable parameters by approximately 100 times.

READ FULL TEXT

page 1

page 8

page 13

research
09/12/2018

EEG-based video identification using graph signal modeling and graph convolutional neural network

This paper proposes a novel graph signal-based deep learning method for ...
research
03/05/2021

Low-latency auditory spatial attention detection based on spectro-spatial features from EEG

Detecting auditory attention based on brain signals enables many everyda...
research
08/28/2023

EEG-Derived Voice Signature for Attended Speaker Detection

Objective: Conventional EEG-based auditory attention detection (AAD) is ...
research
05/28/2019

Brain Signal Classification via Learning Connectivity Structure

Connectivity between different brain regions is one of the most importan...
research
08/17/2022

EEG-BBNet: a Hybrid Framework for Brain Biometric using Graph Connectivity

Brain biometrics based on electroencephalography (EEG) have been used in...
research
05/17/2023

BASEN: Time-Domain Brain-Assisted Speech Enhancement Network with Convolutional Cross Attention in Multi-talker Conditions

Time-domain single-channel speech enhancement (SE) still remains challen...
research
03/20/2023

Relate auditory speech to EEG by shallow-deep attention-based network

Electroencephalography (EEG) plays a vital role in detecting how brain r...

Please sign up or login with your details

Forgot password? Click here to reset