Mind the beat: detecting audio onsets from EEG recordings of music listening

02/12/2021
by   Ashvala Vinay, et al.
0

We propose a deep learning approach to predicting audio event onsets in electroencephalogram (EEG) recorded from users as they listen to music. We use a publicly available dataset containing ten contemporary songs and concurrently recorded EEG. We generate a sequence of onset labels for the songs in our dataset and trained neural networks (a fully connected network (FCN) and a recurrent neural network (RNN)) to parse one second windows of input EEG to predict one second windows of onsets in the audio. We compare our RNN network to both the standard spectral-flux based novelty function and the FCN. We find that our RNN was able to produce results that reflected its ability to generalize better than the other methods. Since there are no pre-existing works on this topic, the numbers presented in this paper may serve as useful benchmarks for future approaches to this research problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/22/2020

Speech Synthesis using EEG

In this paper we demonstrate speech synthesis using different electroenc...
research
09/03/2018

Deep Learning of Human Perception in Audio Event Classification

In this paper, we introduce our recent studies on human perception in au...
research
04/08/2019

Hierarchical Deep Feature Learning For Decoding Imagined Speech From EEG

We propose a mixed deep neural network strategy, incorporating parallel ...
research
05/29/2020

Predicting Different Acoustic Features from EEG and towards direct synthesis of Audio Waveform from EEG

In [1,2] authors provided preliminary results for synthesizing speech fr...
research
09/17/2020

GuessTheMusic: Song Identification from Electroencephalography response

The music signal comprises of different features like rhythm, timbre, me...
research
04/01/2019

Passive Head-Mounted Display Music-Listening EEG dataset

We describe the experimental procedures for a dataset that we have made ...
research
03/11/2019

Labeler-hot Detection of EEG Epileptic Transients

Preventing early progression of epilepsy and so the severity of seizures...

Please sign up or login with your details

Forgot password? Click here to reset