Spectral Adversarial Training for Robust Graph Neural Network

11/20/2022
by   Jintang Li, et al.
0

Recent studies demonstrate that Graph Neural Networks (GNNs) are vulnerable to slight but adversarially designed perturbations, known as adversarial examples. To address this issue, robust training methods against adversarial examples have received considerable attention in the literature. Adversarial Training (AT) is a successful approach to learning a robust model using adversarially perturbed training samples. Existing AT methods on GNNs typically construct adversarial perturbations in terms of graph structures or node features. However, they are less effective and fraught with challenges on graph data due to the discreteness of graph structure and the relationships between connected examples. In this work, we seek to address these challenges and propose Spectral Adversarial Training (SAT), a simple yet effective adversarial training approach for GNNs. SAT first adopts a low-rank approximation of the graph structure based on spectral decomposition, and then constructs adversarial perturbations in the spectral domain rather than directly manipulating the original graph structure. To investigate its effectiveness, we employ SAT on three widely used GNNs. Experimental results on four public graph datasets demonstrate that SAT significantly improves the robustness of GNNs against adversarial attacks without sacrificing classification accuracy and training efficiency.

READ FULL TEXT

page 1

page 9

page 11

page 13

research
06/27/2023

Adversarial Training for Graph Neural Networks

Despite its success in the image domain, adversarial training does not (...
research
02/20/2019

Graph Adversarial Training: Dynamically Regularizing Based on Graph Structure

Recent efforts show that neural networks are vulnerable to small but int...
research
09/12/2021

CoG: a Two-View Co-training Framework for Defending Adversarial Attacks on Graph

Graph neural networks exhibit remarkable performance in graph data analy...
research
05/01/2023

Revisiting Robustness in Graph Machine Learning

Many works show that node-level predictions of Graph Neural Networks (GN...
research
10/28/2021

CAP: Co-Adversarial Perturbation on Weights and Features for Improving Generalization of Graph Neural Networks

Despite the recent advances of graph neural networks (GNNs) in modeling ...
research
10/29/2020

Reliable Graph Neural Networks via Robust Aggregation

Perturbations targeting the graph structure have proven to be extremely ...
research
05/06/2022

Learning Optimal Propagation for Graph Neural Networks

Graph Neural Networks (GNNs) have achieved tremendous success in a varie...

Please sign up or login with your details

Forgot password? Click here to reset