Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Mind the beat: detecting audio onsets from EEG recordings of music listening

Feb 12, 2021
Ashvala Vinay, Alexander Lerch, Grace Leslie

Share this with someone who'll enjoy it:

We propose a deep learning approach to predicting audio event onsets in electroencephalogram (EEG) recorded from users as they listen to music. We use a publicly available dataset containing ten contemporary songs and concurrently recorded EEG. We generate a sequence of onset labels for the songs in our dataset and trained neural networks (a fully connected network (FCN) and a recurrent neural network (RNN)) to parse one second windows of input EEG to predict one second windows of onsets in the audio. We compare our RNN network to both the standard spectral-flux based novelty function and the FCN. We find that our RNN was able to produce results that reflected its ability to generalize better than the other methods. Since there are no pre-existing works on this topic, the numbers presented in this paper may serve as useful benchmarks for future approaches to this research problem.

* to be published in ICASSP 2021 4 figures, 5 pages (4 pages of content + 1 page of references) 

   Access Paper Source

Share this with someone who'll enjoy it: