Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Data Imputation with Iterative Graph Reconstruction

About

Effective data imputation demands rich latent ``structure" discovery capabilities from ``plain" tabular data. Recent advances in graph neural networks-based data imputation solutions show their strong structure learning potential by directly translating tabular data as bipartite graphs. However, due to a lack of relations between samples, those solutions treat all samples equally which is against one important observation: ``similar sample should give more information about missing values." This paper presents a novel Iterative graph Generation and Reconstruction framework for Missing data imputation(IGRM). Instead of treating all samples equally, we introduce the concept: ``friend networks" to represent different relations among samples. To generate an accurate friend network with missing data, an end-to-end friend network reconstruction solution is designed to allow for continuous friend network optimization during imputation learning. The representation of the optimized friend network, in turn, is used to further optimize the data imputation process with differentiated message passing. Experiment results on eight benchmark datasets show that IGRM yields 39.13% lower mean absolute error compared with nine baselines and 9.04% lower than the second-best. Our code is available at https://github.com/G-AILab/IGRM.

Jiajun Zhong, Weiwei Ye, Ning Gui• 2022

Related benchmarks

TaskDatasetResultRank
Data ImputationWINE (test)
RMSE0.1111
205
Classification33 datasets missing rate <= 10% (test)
AUC86.59
65
Classification10 Datasets Missing rate > 10% (test)
AUC80.48
50
Categorical Data ImputationCar (test)
PFC67.47
16
Categorical Data ImputationMushroom (test)
PFC34.54
16
Categorical Data ImputationLETTER (test)
PFC77.93
16
Data ImputationBREAST (test)
RMSE0.1
16
Data ImputationSpam (test)
RMSE0.0571
16
Data ImputationYeast (test)
RMSE0.1243
16
Data ImputationCalifornia (test)
RMSE0.1578
16
Showing 10 of 36 rows

Other info

Follow for update