Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Extended Isolation Forest

About

We present an extension to the model-free anomaly detection algorithm, Isolation Forest. This extension, named Extended Isolation Forest (EIF), resolves issues with assignment of anomaly score to given data points. We motivate the problem using heat maps for anomaly scores. These maps suffer from artifacts generated by the criteria for branching operation of the binary tree. We explain this problem in detail and demonstrate the mechanism by which it occurs visually. We then propose two different approaches for improving the situation. First we propose transforming the data randomly before creation of each tree, which results in averaging out the bias. Second, which is the preferred way, is to allow the slicing of the data to use hyperplanes with random slopes. This approach results in remedying the artifact seen in the anomaly score heat maps. We show that the robustness of the algorithm is much improved using this method by looking at the variance of scores of data points distributed along constant level sets. We report AUROC and AUPRC for our synthetic datasets, along with real-world benchmark datasets. We find no appreciable difference in the rate of convergence nor in computation time between the standard Isolation Forest and EIF.

Sahand Hariri, Matias Carrasco Kind, Robert J. Brunner• 2018

Related benchmarks

TaskDatasetResultRank
Anomaly DetectionShuttle
AUC0.843
39
Anomaly DetectionPageblocks
AUC-ROC0.902
32
Anomaly DetectionFraud
AUC-PR0.378
21
Outlier DetectionSynthetic Mixed Distribution low contamination (γ ∈ {0.01, 0.03, 0.05}) n=500, p=150
F1 Score42.82
14
Outlier DetectionSynthetic Outlier-Free Lognormal Distribution
FPR5
14
Outlier DetectionSynthetic Sustained Mean Shift Mixed distribution, n=500, p=150 (high contamination levels (γ ∈ {10, 15, 20}))
F1 Score19.69
14
Outlier DetectionSynthetic Outlier-Free t-distributed, df=5
Avg FPR0.05
14
Outlier DetectionSynthetic Outlier-Free Mixed Distribution
Avg FPR5
14
Outlier DetectionSynthetic Outlier-Free Normal Distribution
Avg FPR5
14
Outlier DetectionSynthetic Outlier-Free Multimodal Distribution
Average FPR5
14
Showing 10 of 75 rows
...

Other info

Follow for update