Node-wise Localization of Graph Neural Networks

10/27/2021
by   Zemin Liu, et al.
0

Graph neural networks (GNNs) emerge as a powerful family of representation learning models on graphs. To derive node representations, they utilize a global model that recursively aggregates information from the neighboring nodes. However, different nodes reside at different parts of the graph in different local contexts, making their distributions vary across the graph. Ideally, how a node receives its neighborhood information should be a function of its local context, to diverge from the global GNN model shared by all nodes. To utilize node locality without overfitting, we propose a node-wise localization of GNNs by accounting for both global and local aspects of the graph. Globally, all nodes on the graph depend on an underlying global GNN to encode the general patterns across the graph; locally, each node is localized into a unique model as a function of the global model and its local context. Finally, we conduct extensive experiments on four benchmark graphs, and consistently obtain promising performance surpassing the state-of-the-art GNNs.

READ FULL TEXT
research
07/27/2020

Label-Consistency based Graph Neural Networks for Semi-supervised Node Classification

Graph neural networks (GNNs) achieve remarkable success in graph-based s...
research
02/08/2023

On Generalized Degree Fairness in Graph Neural Networks

Conventional graph neural networks (GNNs) are often confronted with fair...
research
06/25/2023

GPatcher: A Simple and Adaptive MLP Model for Alleviating Graph Heterophily

While graph heterophily has been extensively studied in recent years, a ...
research
11/16/2021

Learn Locally, Correct Globally: A Distributed Algorithm for Training Graph Neural Networks

Despite the recent success of Graph Neural Networks (GNNs), training GNN...
research
06/08/2023

On Performance Discrepancies Across Local Homophily Levels in Graph Neural Networks

Research on GNNs has highlighted a relationship between high homophily (...
research
09/11/2020

Beyond Localized Graph Neural Networks: An Attributed Motif Regularization Framework

We present InfoMotif, a new semi-supervised, motif-regularized, learning...
research
11/19/2021

Graph Neural Networks with Feature and Structure Aware Random Walk

Graph Neural Networks (GNNs) have received increasing attention for repr...

Please sign up or login with your details

Forgot password? Click here to reset