Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Deep Evidential Regression

About

Deterministic neural networks (NNs) are increasingly being deployed in safety critical domains, where calibrated, robust, and efficient measures of uncertainty are crucial. In this paper, we propose a novel method for training non-Bayesian NNs to estimate a continuous target as well as its associated evidence in order to learn both aleatoric and epistemic uncertainty. We accomplish this by placing evidential priors over the original Gaussian likelihood function and training the NN to infer the hyperparameters of the evidential distribution. We additionally impose priors during training such that the model is regularized when its predicted evidence is not aligned with the correct output. Our method does not rely on sampling during inference or on out-of-distribution (OOD) examples for training, thus enabling efficient and scalable uncertainty learning. We demonstrate learning well-calibrated measures of uncertainty on various benchmarks, scaling to complex computer vision tasks, as well as robustness to adversarial and OOD test samples.

Alexander Amini, Wilko Schwarting, Ava Soleimany, Daniela Rus• 2019

Related benchmarks

TaskDatasetResultRank
Multimodal Sentiment AnalysisCMU-MOSI (test)
F180.7
238
Traffic Flow ForecastingPEMS08 (test)
MAE16.66
66
Traffic Flow ForecastingPEMS04 (test)
MAE21.11
66
OOD DetectionCT Slices (test)
AUROC67.2
40
Sentiment AnalysisCMU-MOSEI (test)
Acc (2-class)79.9
40
OOD DetectionSuperconductivity (test)
AU-ROC (AU)0.509
24
Multimodal Sentiment AnalysisCMU-MOSI Word Aligned (test)
Accuracy (7-Class)33.4
21
Multimodal Sentiment AnalysisCMU-MOSEI Unaligned (test)
Accuracy (2-Class)81.3
18
Age EstimationIMDB-WIKI-DIR 1.0 (test)
MSE (All)120.9
14
Imbalanced RegressionIMDB-WIKI-DIR (test)
MAE (All)7.24
14
Showing 10 of 56 rows

Other info

Follow for update