Unified Robust Training for Graph NeuralNetworks against Label Noise

03/05/2021
by   Yayong Li, et al.
0

Graph neural networks (GNNs) have achieved state-of-the-art performance for node classification on graphs. The vast majority of existing works assume that genuine node labels are always provided for training. However, there has been very little research effort on how to improve the robustness of GNNs in the presence of label noise. Learning with label noise has been primarily studied in the context of image classification, but these techniques cannot be directly applied to graph-structured data, due to two major challenges – label sparsity and label dependency – faced by learning on graphs. In this paper, we propose a new framework, UnionNET, for learning with noisy labels on graphs under a semi-supervised setting. Our approach provides a unified solution for robustly training GNNs and performing label correction simultaneously. The key idea is to perform label aggregation to estimate node-level class probability distributions, which are used to guide sample reweighting and label correction. Compared with existing works, UnionNET has two appealing advantages. First, it requires no extra clean supervision, or explicit estimation of the noise transition matrix. Second, a unified learning framework is proposed to robustly train GNNs in an end-to-end manner. Experimental results show that our proposed approach: (1) is effective in improving model robustness against different types and levels of label noise; (2) yields significant improvements over state-of-the-art baselines.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/12/2022

Robust Training of Graph Neural Networks via Noise Governance

Graph Neural Networks (GNNs) have become widely-used models for semi-sup...
research
01/20/2022

Informative Pseudo-Labeling for Graph Neural Networks with Few Labels

Graph Neural Networks (GNNs) have achieved state-of-the-art results for ...
research
05/05/2019

Learning Graph Neural Networks with Noisy Labels

We study the robustness to symmetric label noise of GNNs training proced...
research
02/21/2023

Label Information Enhanced Fraud Detection against Low Homophily in Graphs

Node classification is a substantial problem in graph-based fraud detect...
research
05/19/2022

Simplifying Node Classification on Heterophilous Graphs with Compatible Label Propagation

Graph Neural Networks (GNNs) have been predominant for graph learning ta...
research
10/14/2022

Revisiting Heterophily For Graph Neural Networks

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by using...
research
04/15/2022

Neural Structured Prediction for Inductive Node Classification

This paper studies node classification in the inductive setting, i.e., a...

Please sign up or login with your details

Forgot password? Click here to reset