Brain Graph Super-Resolution Using Adversarial Graph Neural Network with Application to Functional Brain Connectivity

05/02/2021
by   Megi Isallari, et al.
0

Brain image analysis has advanced substantially in recent years with the proliferation of neuroimaging datasets acquired at different resolutions. While research on brain image super-resolution has undergone a rapid development in the recent years, brain graph super-resolution is still poorly investigated because of the complex nature of non-Euclidean graph data. In this paper, we propose the first-ever deep graph super-resolution (GSR) framework that attempts to automatically generate high-resolution (HR) brain graphs with N' nodes (i.e., anatomical regions of interest (ROIs)) from low-resolution (LR) graphs with N nodes where N < N'. First, we formalize our GSR problem as a node feature embedding learning task. Once the HR nodes' embeddings are learned, the pairwise connectivity strength between brain ROIs can be derived through an aggregation rule based on a novel Graph U-Net architecture. While typically the Graph U-Net is a node-focused architecture where graph embedding depends mainly on node attributes, we propose a graph-focused architecture where the node feature embedding is based on the graph topology. Second, inspired by graph spectral theory, we break the symmetry of the U-Net architecture by super-resolving the low-resolution brain graph structure and node content with a GSR layer and two graph convolutional network layers to further learn the node embeddings in the HR graph. Third, to handle the domain shift between the ground-truth and the predicted HR brain graphs, we incorporate adversarial regularization to align their respective distributions. Our proposed AGSR-Net framework outperformed its variants for predicting high-resolution functional brain graphs from low-resolution ones. Our AGSR-Net code is available on GitHub at https://github.com/basiralab/AGSR-Net.

READ FULL TEXT

page 10

page 22

research
09/23/2020

GSR-Net: Graph Super-Resolution Network for Predicting High-Resolution from Low-Resolution Functional Brain Connectomes

Catchy but rigorous deep learning architectures were tailored for image ...
research
10/06/2021

Inter-Domain Alignment for Predicting High-Resolution Brain Networks Using Teacher-Student Learning

Accurate and automated super-resolution image synthesis is highly desire...
research
08/30/2020

Deep Hypergraph U-Net for Brain Graph Embedding and Classification

-Background. Network neuroscience examines the brain as a complex system...
research
06/13/2022

Biologically Inspired Neural Path Finding

The human brain can be considered to be a graphical structure comprising...
research
10/06/2021

StairwayGraphNet for Inter- and Intra-modality Multi-resolution Brain Graph Alignment and Synthesis

Synthesizing multimodality medical data provides complementary knowledge...
research
09/24/2020

Multi-View Brain HyperConnectome AutoEncoder For Brain State Classification

Graph embedding is a powerful method to represent graph neurological dat...
research
05/30/2022

Deep Posterior Distribution-based Embedding for Hyperspectral Image Super-resolution

In this paper, we investigate the problem of hyperspectral (HS) image sp...

Please sign up or login with your details

Forgot password? Click here to reset