GNN-Ensemble: Towards Random Decision Graph Neural Networks

03/20/2023
by   Wenqi Wei, et al.
0

Graph Neural Networks (GNNs) have enjoyed wide spread applications in graph-structured data. However, existing graph based applications commonly lack annotated data. GNNs are required to learn latent patterns from a limited amount of training data to perform inferences on a vast amount of test data. The increased complexity of GNNs, as well as a single point of model parameter initialization, usually lead to overfitting and sub-optimal performance. In addition, it is known that GNNs are vulnerable to adversarial attacks. In this paper, we push one step forward on the ensemble learning of GNNs with improved accuracy, generalization, and adversarial robustness. Following the principles of stochastic modeling, we propose a new method called GNN-Ensemble to construct an ensemble of random decision graph neural networks whose capacity can be arbitrarily expanded for improvement in performance. The essence of the method is to build multiple GNNs in randomly selected substructures in the topological space and subfeatures in the feature space, and then combine them for final decision making. These GNNs in different substructure and subfeature spaces generalize their classification in complementary ways. Consequently, their combined classification performance can be improved and overfitting on the training data can be effectively reduced. In the meantime, we show that GNN-Ensemble can significantly improve the adversarial robustness against attacks on GNNs.

READ FULL TEXT
research
10/21/2021

Watermarking Graph Neural Networks based on Backdoor Attacks

Graph Neural Networks (GNNs) have achieved promising performance in vari...
research
08/20/2019

Robust Graph Neural Network Against Poisoning Attacks via Transfer Learning

Graph neural networks (GNNs) are widely used in many applications. Howev...
research
03/01/2021

Snowflake: Scaling GNNs to High-Dimensional Continuous Control via Parameter Freezing

Recent research has shown that Graph Neural Networks (GNNs) can learn po...
research
06/21/2021

Graph Attention Networks with LSTM-based Path Reweighting

Graph Neural Networks (GNNs) have been extensively used for mining graph...
research
03/12/2021

Graph Ensemble Learning over Multiple Dependency Trees for Aspect-level Sentiment Classification

Recent work on aspect-level sentiment classification has demonstrated th...
research
10/23/2020

Incorporating Symbolic Domain Knowledge into Graph Neural Networks

Our interest is in scientific problems with the following characteristic...
research
06/14/2021

Improving Robustness of Graph Neural Networks with Heterophily-Inspired Designs

Recent studies have exposed that many graph neural networks (GNNs) are s...

Please sign up or login with your details

Forgot password? Click here to reset