Beyond Localized Graph Neural Networks: An Attributed Motif Regularization Framework

by   Aravind Sankar, et al.

We present InfoMotif, a new semi-supervised, motif-regularized, learning framework over graphs. We overcome two key limitations of message passing in popular graph neural networks (GNNs): localization (a k-layer GNN cannot utilize features outside the k-hop neighborhood of the labeled training nodes) and over-smoothed (structurally indistinguishable) representations. We propose the concept of attributed structural roles of nodes based on their occurrence in different network motifs, independent of network proximity. Two nodes share attributed structural roles if they participate in topologically similar motif instances over co-varying sets of attributes. Further, InfoMotif achieves architecture independence by regularizing the node representations of arbitrary GNNs via mutual information maximization. Our training curriculum dynamically prioritizes multiple motifs in the learning process without relying on distributional assumptions in the underlying graph or the learning task. We integrate three state-of-the-art GNNs in our framework, to show significant gains (3-10 gains for nodes with sparse training labels and diverse attributes in local neighborhood structures.


page 1

page 9


NEAR: Neighborhood Edge AggregatoR for Graph Classification

Learning graph-structured data with graph neural networks (GNNs) has bee...

Pre-train and Learn: Preserve Global Information for Graph Neural Networks

Graph neural networks (GNNs) have shown great power in learning on attri...

Breaking the Limit of Graph Neural Networks by Improving the Assortativity of Graphs with Local Mixing Patterns

Graph neural networks (GNNs) have achieved tremendous success on multipl...

Ego-based Entropy Measures for Structural Representations on Graphs

Machine learning on graph-structured data has attracted high research in...

Graph Auto-Encoder Via Neighborhood Wasserstein Reconstruction

Graph neural networks (GNNs) have drawn significant research attention r...

Local, global and scale-dependent node roles

This paper re-examines the concept of node equivalences like structural ...

Graph Summarization with Graph Neural Networks

The goal of graph summarization is to represent large graphs in a struct...