Revisiting graph neural networks and distance encoding in a practical view

11/22/2020
by   Haoteng Yin, et al.
0

Graph neural networks (GNNs) are widely used in the applications based on graph structured data, such as node classification and link prediction. However, GNNs are often used as a black-box tool and rarely get in-depth investigated regarding whether they fit certain applications that may have various properties. A recently proposed technique distance encoding (DE) (Li et al. 2020) magically makes GNNs work well in many applications, including node classification and link prediction. The theory provided in (Li et al. 2020) supports DE by proving that DE improves the representation power of GNNs. However, it is not obvious how the theory assists the applications accordingly. Here, we revisit GNNs and DE from a more practical point of view. We want to explain how DE makes GNNs fit for node classification and link prediction. Specifically, for link prediction, DE can be viewed as a way to establish correlations between a pair of node representations. For node classification, the problem becomes more complicated as different classification tasks may hold node labels that indicate different physical meanings. We focus on the most widely-considered node classification scenarios and categorize the node labels into two types, community type and structure type, and then analyze different mechanisms that GNNs adopt to predict these two types of labels. We also run extensive experiments to compare eight different configurations of GNNs paired with DE to predict node labels over eight real-world graphs. The results demonstrate the uniform effectiveness of DE to predict structure-type labels. Lastly, we reach three pieces of conclusions on how to use GNNs and DE properly in tasks of node classification.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/09/2022

Neo-GNNs: Neighborhood Overlap-aware Graph Neural Networks for Link Prediction

Graph Neural Networks (GNNs) have been widely applied to various fields ...
research
08/31/2020

Distance Encoding – Design Provably More Powerful Graph Neural Networks for Structural Representation Learning

Learning structural representations of node sets from graph-structured d...
research
03/29/2021

Modeling Graph Node Correlations with Neighbor Mixture Models

We propose a new model, the Neighbor Mixture Model (NMM), for modeling n...
research
08/22/2023

Graph Encoding and Neural Network Approaches for Volleyball Analytics: From Game Outcome to Individual Play Predictions

This research aims to improve the accuracy of complex volleyball predict...
research
10/11/2022

Linkless Link Prediction via Relational Distillation

Graph Neural Networks (GNNs) have been widely used on graph data and hav...
research
04/15/2022

Neural Structured Prediction for Inductive Node Classification

This paper studies node classification in the inductive setting, i.e., a...
research
02/08/2022

Bandit Sampling for Multiplex Networks

Graph neural networks have gained prominence due to their excellent perf...

Please sign up or login with your details

Forgot password? Click here to reset