Towards Scale-Invariant Graph-related Problem Solving by Iterative Homogeneous Graph Neural Networks

10/26/2020
by   Hao Tang, et al.
0

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs, we propose several extensions to address the issue. First, inspired by the dependency of the iteration number of common graph theory algorithms on graph size, we learn to terminate the message passing process in GNNs adaptively according to the computation progress. Second, inspired by the fact that many graph theory algorithms are homogeneous with respect to graph weights, we introduce homogeneous transformation layers that are universal homogeneous function approximators, to convert ordinary GNNs to be homogeneous. Experimentally, we show that our GNN can be trained from small-scale graphs but generalize well to large-scale graphs for a number of basic graph theory problems. It also shows generalizability for applications of multi-body physical simulation and image-based navigation problems.

READ FULL TEXT

page 7

page 29

research
10/02/2022

Gradient Gating for Deep Multi-Rate Learning on Graphs

We present Gradient Gating (G^2), a novel framework for improving the pe...
research
01/31/2022

GSN: A Universal Graph Neural Network Inspired by Spring Network

The design of universal Graph Neural Networks (GNNs) that operate on bot...
research
09/30/2022

MLPInit: Embarrassingly Simple GNN Training Acceleration with MLP Initialization

Training graph neural networks (GNNs) on large graphs is complex and ext...
research
06/07/2021

Increase and Conquer: Training Graph Neural Networks on Growing Graphs

Graph neural networks (GNNs) use graph convolutions to exploit network i...
research
12/09/2022

Learning Graph Algorithms With Recurrent Graph Neural Networks

Classical graph algorithms work well for combinatorial problems that can...
research
10/23/2019

Neural Execution of Graph Algorithms

Graph Neural Networks (GNNs) are a powerful representational tool for so...
research
07/06/2021

Non-Homogeneity Estimation and Universal Kriging on the Sphere

Kriging is a widely recognized method for making spatial predictions. On...

Please sign up or login with your details

Forgot password? Click here to reset