Learning to Drop: Robust Graph Neural Network via Topological Denoising

11/13/2020
by   Dongsheng Luo, et al.
1

Graph Neural Networks (GNNs) have shown to be powerful tools for graph analytics. The key idea is to recursively propagate and aggregate information along edges of the given graph. Despite their success, however, the existing GNNs are usually sensitive to the quality of the input graph. Real-world graphs are often noisy and contain task-irrelevant edges, which may lead to suboptimal generalization performance in the learned GNN models. In this paper, we propose PTDNet, a parameterized topological denoising network, to improve the robustness and generalization performance of GNNs by learning to drop task-irrelevant edges. PTDNet prunes task-irrelevant edges by penalizing the number of edges in the sparsified graph with parameterized networks. To take into consideration of the topology of the entire graph, the nuclear norm regularization is applied to impose the low-rank constraint on the resulting sparsified graph for better generalization. PTDNet can be used as a key component in GNN models to improve their performances on various tasks, such as node classification and link prediction. Experimental studies on both synthetic and benchmark datasets show that PTDNet can improve the performance of GNNs significantly and the performance gain becomes larger for more noisy datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

12/02/2019

Sparse Graph Attention Networks

Graph Neural Networks (GNNs) have proved to be an effective representati...
08/20/2019

Robust Graph Neural Network Against Poisoning Attacks via Transfer Learning

Graph neural networks (GNNs) are widely used in many applications. Howev...
06/05/2021

Training Robust Graph Neural Networks with Topology Adaptive Edge Dropping

Graph neural networks (GNNs) are processing architectures that exploit g...
02/18/2020

Self-Enhanced GNN: Improving Graph Neural Networks Using Model Outputs

Graph neural networks (GNNs) have received much attention recently becau...
07/16/2022

SizeShiftReg: a Regularization Method for Improving Size-Generalization in Graph Neural Networks

In the past few years, graph neural networks (GNNs) have become the de f...
08/21/2022

Robust Node Classification on Graphs: Jointly from Bayesian Label Transition and Topology-based Label Propagation

Node classification using Graph Neural Networks (GNNs) has been widely a...
02/28/2022

GraphWorld: Fake Graphs Bring Real Insights for GNNs

Despite advances in the field of Graph Neural Networks (GNNs), only a sm...