EEG to fMRI Synthesis Benefits from Attentional Graphs of Electrode Relationships

03/07/2022
by   David Calhas, et al.
0

Topographical structures represent connections between entities and provide a comprehensive design of complex systems. Currently these structures are used to discover correlates of neuronal and haemodynamical activity. In this work, we incorporate them with neural processing techniques to perform regression, using electrophysiological activity to retrieve haemodynamics. To this end, we use Fourier features, attention mechanisms, shared space between modalities and incorporation of style in the latent representation. By combining these techniques, we propose several models that significantly outperform current state-of-the-art of this task in resting state and task-based recording settings. We report which EEG electrodes are the most relevant for the regression task and which relations impacted it the most. In addition, we observe that haemodynamic activity at the scalp, in contrast with sub-cortical regions, is relevant to the learned shared space. Overall, these results suggest that EEG electrode relationships are pivotal to retain information necessary for haemodynamical activity retrieval.

READ FULL TEXT

page 12

page 23

page 25

research
10/05/2020

Latent neural source recovery via transcoding of simultaneous EEG-fMRI

Simultaneous EEG-fMRI is a multi-modal neuroimaging technique that provi...
research
09/29/2020

EEG to fMRI Synthesis: Is Deep Learning a candidate?

Advances on signal, image and video generation underly major breakthroug...
research
07/25/2023

Neural Memory Decoding with EEG Data and Representation Learning

We describe a method for the neural decoding of memory from EEG data. Us...
research
07/22/2019

Adversarial Feature Learning in Brain Interfacing: An Experimental Study on Eliminating Drowsiness Effects

Across- and within-recording variabilities in electroencephalographic (E...
research
10/12/2020

The "Sound of Silence" in EEG – Cognitive voice activity detection

Speech cognition bears potential application as a brain computer interfa...
research
09/17/2018

Automatic Electrodes Detection during simultaneous EEG/fMRI acquisition

Simultaneous EEG/fMRI acquisition allows to measure brain activity at hi...
research
10/13/2017

The Analysis of Face Perception MEG and EEG Data Using a Potts-Mixture Spatiotemporal Joint Model

In this paper we analyze magnetoencephalography (MEG) and electroencepha...

Please sign up or login with your details

Forgot password? Click here to reset