Tensor Analysis and Fusion of Multimodal Brain Images

by   Esin Karahan, et al.

Current high-throughput data acquisition technologies probe dynamical systems with different imaging modalities, generating massive data sets at different spatial and temporal resolutions posing challenging problems in multimodal data fusion. A case in point is the attempt to parse out the brain structures and networks that underpin human cognitive processes by analysis of different neuroimaging modalities (functional MRI, EEG, NIRS etc.). We emphasize that the multimodal, multi-scale nature of neuroimaging data is well reflected by a multi-way (tensor) structure where the underlying processes can be summarized by a relatively small number of components or "atoms". We introduce Markov-Penrose diagrams - an integration of Bayesian DAG and tensor network notation in order to analyze these models. These diagrams not only clarify matrix and tensor EEG and fMRI time/frequency analysis and inverse problems, but also help understand multimodal fusion via Multiway Partial Least Squares and Coupled Matrix-Tensor Factorization. We show here, for the first time, that Granger causal analysis of brain networks is a tensor regression problem, thus allowing the atomic decomposition of brain networks. Analysis of EEG and fMRI recordings shows the potential of the methods and suggests their use in other scientific domains.



There are no comments yet.


page 1

page 2

page 10

page 14

page 15

page 16

page 17

page 18


Early soft and flexible fusion of EEG and fMRI via tensor decompositions

Data fusion refers to the joint analysis of multiple datasets which prov...

Augmenting interictal mapping with neurovascular coupling biomarkers by structured factorization of epileptic EEG and fMRI data

EEG-correlated fMRI analysis is widely used to detect regional blood oxy...

Improving Classification Rate of Schizophrenia Using a Multimodal Multi-Layer Perceptron Model with Structural and Functional MR

The wide variety of brain imaging technologies allows us to exploit info...

Automatic Electrodes Detection during simultaneous EEG/fMRI acquisition

Simultaneous EEG/fMRI acquisition allows to measure brain activity at hi...

Complex tensor factorisation with PARAFAC2 for the estimation of brain connectivity from the EEG

Objective: The coupling between neuronal populations and its magnitude h...

Latent neural source recovery via transcoding of simultaneous EEG-fMRI

Simultaneous EEG-fMRI is a multi-modal neuroimaging technique that provi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.