Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Censored Quantile Regression Neural Networks for Distribution-Free Survival Analysis

About

This paper considers doing quantile regression on censored data using neural networks (NNs). This adds to the survival analysis toolkit by allowing direct prediction of the target variable, along with a distribution-free characterisation of uncertainty, using a flexible function approximator. We begin by showing how an algorithm popular in linear models can be applied to NNs. However, the resulting procedure is inefficient, requiring sequential optimisation of an individual NN at each desired quantile. Our major contribution is a novel algorithm that simultaneously optimises a grid of quantiles output by a single NN. To offer theoretical insight into our algorithm, we show firstly that it can be interpreted as a form of expectation-maximisation, and secondly that it exhibits a desirable `self-correcting' property. Experimentally, the algorithm produces quantiles that are better calibrated than existing methods on 10 out of 12 real datasets.

Tim Pearce, Jong-Hyeon Jeong, Yichen Jia, Jun Zhu• 2022

Related benchmarks

TaskDatasetResultRank
Censored Quantile RegressionNorm linear (test)
MSE (Quantile)0.088
5
Censored Quantile RegressionExponential (test)
MSE to true quantile1.298
5
Censored Quantile RegressionWeibull (test)
MSE (Quantile)0.255
5
Censored Quantile RegressionNorm heavy (test)
MSE0.579
5
Censored Quantile RegressionNorm med. (test)
MSE0.11
5
Censored Quantile RegressionNorm light (test)
MSE (Quantile)0.079
5
Censored Quantile RegressionNorm same (test)
MSE to True Quantile0.094
5
Censored Quantile RegressionNorm non-lin (test)
MSE to True Quantile0.028
5
Censored Quantile RegressionNorm uniform (test)
MSE to True Quantile0.388
5
Censored Quantile RegressionLogNorm light (test)
MSE0.506
5
Showing 10 of 14 rows

Other info

Code

Follow for update