Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Unified Robust Training for Graph NeuralNetworks against Label Noise

About

Graph neural networks (GNNs) have achieved state-of-the-art performance for node classification on graphs. The vast majority of existing works assume that genuine node labels are always provided for training. However, there has been very little research effort on how to improve the robustness of GNNs in the presence of label noise. Learning with label noise has been primarily studied in the context of image classification, but these techniques cannot be directly applied to graph-structured data, due to two major challenges -- label sparsity and label dependency -- faced by learning on graphs. In this paper, we propose a new framework, UnionNET, for learning with noisy labels on graphs under a semi-supervised setting. Our approach provides a unified solution for robustly training GNNs and performing label correction simultaneously. The key idea is to perform label aggregation to estimate node-level class probability distributions, which are used to guide sample reweighting and label correction. Compared with existing works, UnionNET has two appealing advantages. First, it requires no extra clean supervision, or explicit estimation of the noise transition matrix. Second, a unified learning framework is proposed to robustly train GNNs in an end-to-end manner. Experimental results show that our proposed approach: (1) is effective in improving model robustness against different types and levels of label noise; (2) yields significant improvements over state-of-the-art baselines.

Yayong Li, Jie yin, Ling Chen• 2021

Related benchmarks

TaskDatasetResultRank
Node ClassificationCora (test)
Mean Accuracy72.83
951
Node ClassificationPubmed 20% pair noise (test)
Accuracy0.714
24
Node ClassificationPubmed 20% Uniform Noise (test)
Accuracy70.2
24
Node ClassificationCiteseer 20% Uniform Noise (test)
Accuracy66.5
17
Node ClassificationCora 20% Uniform Noise (test)
Accuracy76.1
17
Node ClassificationPubmed
Training Time per Epoch (s)9.05
13
Node ClassificationCiteseer Pair noise (20%) (test)
Accuracy61.5
7
Node ClassificationCora Pair noise (20%) (test)
Accuracy73
7
Graph Node ClassificationDBLP
Training Time (s)10.75
5
Graph Node ClassificationA-Photo
Avg Training Time (s)37.36
5
Showing 10 of 13 rows

Other info

Follow for update