Latent neural source recovery via transcoding of simultaneous EEG-fMRI

by   Xueqing Liu, et al.

Simultaneous EEG-fMRI is a multi-modal neuroimaging technique that provides complementary spatial and temporal resolution for inferring a latent source space of neural activity. In this paper we address this inference problem within the framework of transcoding – mapping from a specific encoding (modality) to a decoding (the latent source space) and then encoding the latent source space to the other modality. Specifically, we develop a symmetric method consisting of a cyclic convolutional transcoder that transcodes EEG to fMRI and vice versa. Without any prior knowledge of either the hemodynamic response function or lead field matrix, the method exploits the temporal and spatial relationships between the modalities and latent source spaces to learn these mappings. We show, for real EEG-fMRI data, how well the modalities can be transcoded from one to another as well as the source spaces that are recovered, all on unseen data. In addition to enabling a new way to symmetrically infer a latent source space, the method can also be seen as low-cost computational neuroimaging – i.e. generating an 'expensive' fMRI BOLD image from 'low cost' EEG data.



There are no comments yet.


page 3

page 6

page 8


Automatic Electrodes Detection during simultaneous EEG/fMRI acquisition

Simultaneous EEG/fMRI acquisition allows to measure brain activity at hi...

EEG to fMRI Synthesis Benefits from Attentional Graphs of Electrode Relationships

Topographical structures represent connections between entities and prov...

Augmenting interictal mapping with neurovascular coupling biomarkers by structured factorization of epileptic EEG and fMRI data

EEG-correlated fMRI analysis is widely used to detect regional blood oxy...

Early soft and flexible fusion of EEG and fMRI via tensor decompositions

Data fusion refers to the joint analysis of multiple datasets which prov...

Tensor Analysis and Fusion of Multimodal Brain Images

Current high-throughput data acquisition technologies probe dynamical sy...

Simultaneous Skull Conductivity and Focal Source Imaging from EEG Recordings with the help of Bayesian Uncertainty Modelling

The electroencephalography (EEG) source imaging problem is very sensitiv...

Single Shot Reversible GAN for BCG artifact removal in simultaneous EEG-fMRI

Simultaneous EEG-fMRI acquisition and analysis technology has been widel...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.