Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Interpretable Generalized Additive Models for Datasets with Missing Values

About

Many important datasets contain samples that are missing one or more feature values. Maintaining the interpretability of machine learning models in the presence of such missing data is challenging. Singly or multiply imputing missing values complicates the model's mapping from features to labels. On the other hand, reasoning on indicator variables that represent missingness introduces a potentially large number of additional terms, sacrificing sparsity. We solve these problems with M-GAM, a sparse, generalized, additive modeling approach that incorporates missingness indicators and their interaction terms while maintaining sparsity through l0 regularization. We show that M-GAM provides similar or superior accuracy to prior methods while significantly improving sparsity relative to either imputation or naive inclusion of indicator variables.

Hayden McTavish, Jon Donnelly, Margo Seltzer, Cynthia Rudin• 2024

Related benchmarks

TaskDatasetResultRank
Binary ClassificationFICO (test)
AUROC77.9
32
Prediction under missing valuesLIFE (test)
AUROC98.2
24
PredictionPharyngitis (test)
AUROC71.7
19
PredictionBreast Cancer (test)
AUROC72.5
19
Prediction under missing valuesFICO (test)
AUROC77.9
12
Binary ClassificationNHANES (test)
AUROC84.1
12
Prediction under missing valuesNHANES (test)
AUROC84.1
12
Binary ClassificationADNI (test)
AUROC69.7
12
Prediction under missing valuesADNI (test)
AUROC69.7
12
Showing 9 of 9 rows

Other info

Follow for update