Bag of Tricks of Semi-Supervised Classification with Graph Neural Networks

03/24/2021
by   Yangkun Wang, et al.
0

Much of the recent progress made in node classification on graphs can be credited to the careful design on graph neural networks (GNN) and label propagation algorithms. However, in the literature, in addition to improvements to the model architecture, there are a number of improvements either briefly mentioned as implementation details or visible only in source code, and these overlooked techniques may play a pivotal role in their practical use. In this paper, we first summarize a collection of existing refinements, and then propose several novel techniques regarding these model designs and label usage. We empirically evaluate their impacts on the final model accuracy through ablation studies, and show that we are able to significantly improve various GNN models to the extent that they outweigh the gains from model architecture improvement. Notably, many of the top-ranked models on Open Graph Benchmark benefit from our techniques.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/04/2018

Bag of Tricks for Image Classification with Convolutional Neural Networks

Much of the recent progress made in image classification research can be...
research
06/12/2019

Multiple instance learning with graph neural networks

Multiple instance learning (MIL) aims to learn the mapping between a bag...
research
11/12/2021

Simplifying approach to Node Classification in Graph Neural Networks

Graph Neural Networks have become one of the indispensable tools to lear...
research
05/18/2021

Residual Network and Embedding Usage: New Tricks of Node Classification with Graph Convolutional Networks

Graph Convolutional Networks (GCNs) and subsequent variants have been pr...
research
03/23/2022

Semi-Supervised Graph Learning Meets Dimensionality Reduction

Semi-supervised learning (SSL) has recently received increased attention...
research
12/30/2021

TextRGNN: Residual Graph Neural Networks for Text Classification

Recently, text classification model based on graph neural network (GNN) ...
research
09/07/2022

Spotting Virus from Satellites: Modeling the Circulation of West Nile Virus Through Graph Neural Networks

The occurrence of West Nile Virus (WNV) represents one of the most commo...

Please sign up or login with your details

Forgot password? Click here to reset