MGNNI: Multiscale Graph Neural Networks with Implicit Layers

10/15/2022
by   Juncheng Liu, et al.
0

Recently, implicit graph neural networks (GNNs) have been proposed to capture long-range dependencies in underlying graphs. In this paper, we introduce and justify two weaknesses of implicit GNNs: the constrained expressiveness due to their limited effective range for capturing long-range dependencies, and their lack of ability to capture multiscale information on graphs at multiple resolutions. To show the limited effective range of previous implicit GNNs, We first provide a theoretical analysis and point out the intrinsic relationship between the effective range and the convergence of iterative equations used in these models. To mitigate the mentioned weaknesses, we propose a multiscale graph neural network with implicit layers (MGNNI) which is able to model multiscale structures on graphs and has an expanded effective range for capturing long-range dependencies. We conduct comprehensive experiments for both node classification and graph classification to show that MGNNI outperforms representative baselines and has a better ability for multiscale modeling and capturing of long-range dependencies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/14/2020

Implicit Graph Neural Networks

Graph Neural Networks (GNNs) are widely used deep learning models that l...
research
02/17/2023

Search to Capture Long-range Dependency with Stacking GNNs for Graph Classification

In recent years, Graph Neural Networks (GNNs) have been popular in the g...
research
05/27/2022

Capturing Graphs with Hypo-Elliptic Diffusions

Convolutional layers within graph neural networks operate by aggregating...
research
07/18/2023

Neural Priority Queues for Graph Neural Networks

Graph Neural Networks (GNNs) have shown considerable success in neural a...
research
12/02/2022

Multiscale Graph Neural Networks for Protein Residue Contact Map Prediction

Machine learning (ML) is revolutionizing protein structural analysis, in...
research
11/12/2021

Implicit vs Unfolded Graph Neural Networks

It has been observed that graph neural networks (GNN) sometimes struggle...
research
06/29/2022

Optimization-Induced Graph Implicit Nonlinear Diffusion

Due to the over-smoothing issue, most existing graph neural networks can...

Please sign up or login with your details

Forgot password? Click here to reset