Two-stage Training of Graph Neural Networks for Graph Classification

11/10/2020
by   Manh Tuan Do, et al.
0

Graph Neural Networks (GNNs) have received massive attention in the field of machine learning on graphs. Inspired by the success of neural networks, a line of research has been conducted to train GNNs to deal with various tasks, such as node classification, graph classification, and link prediction. In this work, our task of interest is graph classification. Several GNN models have been proposed and shown great accuracy in this task. However, the question is whether usual training methods fully realizes the power of the GNN models. In this work, we propose a two-stage training framework based on triplet loss. In the first stage, GNN is trained to map each graph to a Euclidean-space vector so that graphs of the same class are close while those of different classes are mapped far apart. Once graphs are well-separated based on labels, a classifier can be trained to distinguish between different classes. This method is generic in the sense that it is compatible with any GNN model. By adapting five GNN models to our method, we demonstrate the consistent improvement in accuracy over the original training method of each model up to 5.4 12 datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/17/2021

Membership Inference Attack on Graph Neural Networks

Graph Neural Networks (GNNs), which generalize traditional deep neural n...
research
11/14/2018

Pitfalls of Graph Neural Network Evaluation

Semi-supervised node classification in graphs is a fundamental problem i...
research
07/16/2022

SizeShiftReg: a Regularization Method for Improving Size-Generalization in Graph Neural Networks

In the past few years, graph neural networks (GNNs) have become the de f...
research
11/22/2021

Learnable Structural Semantic Readout for Graph Classification

With the great success of deep learning in various domains, graph neural...
research
09/11/2022

Towards Sparsification of Graph Neural Networks

As real-world graphs expand in size, larger GNN models with billions of ...
research
06/30/2020

Track Seeding and Labelling with Embedded-space Graph Neural Networks

To address the unprecedented scale of HL-LHC data, the Exa.TrkX project ...
research
10/01/2022

Diving into Unified Data-Model Sparsity for Class-Imbalanced Graph Representation Learning

Even pruned by the state-of-the-art network compression methods, Graph N...

Please sign up or login with your details

Forgot password? Click here to reset