Compact Convolutional Neural Networks for Classification of Asynchronous Steady-state Visual Evoked Potentials

03/12/2018
by   Nicholas R. Waytowich, et al.
0

Steady-State Visual Evoked Potentials (SSVEPs) are neural oscillations from the parietal and occipital regions of the brain that are evoked from flickering visual stimuli. SSVEPs are robust signals measurable in the electroencephalogram (EEG) and are commonly used in brain-computer interfaces (BCIs). However, methods for high-accuracy decoding of SSVEPs usually require hand-crafted approaches that leverage domain-specific knowledge of the stimulus signals, such as specific temporal frequencies in the visual stimuli and their relative spatial arrangement. When this knowledge is unavailable, such as when SSVEP signals are acquired asynchronously, such approaches tend to fail. In this paper, we show how a compact convolutional neural network (Compact-CNN), which only requires raw EEG signals for automatic feature extraction, can be used to decode signals from a 12-class SSVEP dataset without the need for any domain-specific knowledge or calibration data. We report across subject mean accuracy of approximately 80 substantially better than current state-of-the-art hand-crafted approaches using canonical correlation analysis (CCA) and Combined-CCA. Furthermore, we analyze our Compact-CNN to examine the underlying feature representation, discovering that the deep learner extracts additional phase and amplitude related features associated with the structure of the dataset. We discuss how our Compact-CNN shows promise for BCI applications that allow users to freely gaze/attend to any stimulus at any time (e.g., asynchronous BCI) as well as provides a method for analyzing SSVEP signals in a way that might augment our understanding about the basic processing in the visual cortex.

READ FULL TEXT

page 4

page 9

research
05/10/2018

On the Classification of SSVEP-Based Dry-EEG Signals via Convolutional Neural Networks

In this paper, we propose a novel Convolutional Neural Network (CNN) app...
research
06/27/2020

An Evoked Potential-Guided Deep Learning Brain Representation For Visual Classification

The new perspective in visual classification aims to decode the feature ...
research
02/02/2016

Comparative evaluation of state-of-the-art algorithms for SSVEP-based BCIs

Brain-computer interfaces (BCIs) have been gaining momentum in making hu...
research
11/26/2018

Using Variable Natural Environment Brain-Computer Interface Stimuli for Real-time Humanoid Robot Navigation

This paper addresses the challenge of humanoid robot teleoperation in a ...
research
06/07/2020

EnK: Encoding time-information in convolution

Recent development in deep learning techniques has attracted attention i...
research
01/02/2022

DF-SSmVEP: Dual Frequency Aggregated Steady-State Motion Visual Evoked Potential Design with Bifold Canonical Correlation Analysis

Recent advancements in Electroencephalography (EEG) sensor technologies ...
research
03/05/2021

Low-latency auditory spatial attention detection based on spectro-spatial features from EEG

Detecting auditory attention based on brain signals enables many everyda...

Please sign up or login with your details

Forgot password? Click here to reset