Multiplex Graph Networks for Multimodal Brain Network Analysis

07/31/2021
by   Zhaoming Kong, et al.
0

In this paper, we propose MGNet, a simple and effective multiplex graph convolutional network (GCN) model for multimodal brain network analysis. The proposed method integrates tensor representation into the multiplex GCN model to extract the latent structures of a set of multimodal brain networks, which allows an intuitive 'grasping' of the common space for multimodal data. Multimodal representations are then generated with multiplex GCNs to capture specific graph structures. We conduct classification task on two challenging real-world datasets (HIV and Bipolar disorder), and the proposed MGNet demonstrates state-of-the-art performance compared to competitive benchmark methods. Apart from objective evaluations, this study may bear special significance upon network theory to the understanding of human connectome in different modalities. The code is available at https://github.com/ZhaomingKong/MGNets.

READ FULL TEXT

page 7

page 8

research
07/04/2020

Simple and Deep Graph Convolutional Networks

Graph convolutional networks (GCNs) are a powerful deep learning approac...
research
03/16/2023

AU-aware graph convolutional network for Macro- and Micro-expression spotting

Automatic Micro-Expression (ME) spotting in long videos is a crucial ste...
research
05/02/2023

Multi-Head Graph Convolutional Network for Structural Connectome Classification

We tackle classification based on brain connectivity derived from diffus...
research
11/13/2022

A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendation

Multimodal recommender systems utilizing multimodal features (e.g. image...
research
09/09/2021

Graph Based Network with Contextualized Representations of Turns in Dialogue

Dialogue-based relation extraction (RE) aims to extract relation(s) betw...
research
04/26/2016

Using Indirect Encoding of Multiple Brains to Produce Multimodal Behavior

An important challenge in neuroevolution is to evolve complex neural net...
research
09/25/2022

Multimodal Exponentially Modified Gaussian Oscillators

Acoustic modeling serves audio processing tasks such as de-noising, data...

Please sign up or login with your details

Forgot password? Click here to reset