Node Masking: Making Graph Neural Networks Generalize and Scale Better

01/17/2020
by   Pushkar Mishra, et al.
0

Graph Neural Networks (GNNs) have received a lot of interest in the recent times. From the early spectral architectures that could only operate on undirected graphs per a transductive learning paradigm to the current state of the art spatial ones that can apply inductively to arbitrary graphs, GNNs have seen significant contributions from the research community. In this paper, we discuss some theoretical tools to better visualize the operations performed by state of the art spatial GNNs. We analyze the inner workings of these architectures and introduce a simple concept, node masking, that allows them to generalize and scale better. To empirically validate the theory, we perform several experiments on two widely used benchmark datasets for node classification in both transductive and inductive settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/26/2021

Beyond Low-Pass Filters: Adaptive Feature Propagation on Graphs

Graph neural networks (GNNs) have been extensively studied for predictio...
research
09/14/2022

Towards Better Generalization with Flexible Representation of Multi-Module Graph Neural Networks

Graph neural networks (GNNs) have become compelling models designed to p...
research
03/15/2022

Incorporating Heterophily into Graph Neural Networks for Graph Classification

Graph neural networks (GNNs) often assume strong homophily in graphs, se...
research
04/15/2022

Neural Structured Prediction for Inductive Node Classification

This paper studies node classification in the inductive setting, i.e., a...
research
11/03/2021

How Neural Architectures Affect Deep Learning for Communication Networks?

In recent years, there has been a surge in applying deep learning to var...
research
06/15/2022

DiffWire: Inductive Graph Rewiring via the Lovász Bound

Graph Neural Networks (GNNs) have been shown to achieve competitive resu...
research
01/20/2021

Directed Acyclic Graph Neural Networks

Graph-structured data ubiquitously appears in science and engineering. G...

Please sign up or login with your details

Forgot password? Click here to reset