Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Root Cause Analysis of Outliers with Missing Structural Knowledge

About

The goal of Root Cause Analysis (RCA) is to explain why an anomaly occurred by identifying where the fault originated. Several recent works model the anomalous event as resulting from a change in the causal mechanism at the root cause, i.e., as a soft intervention. RCA is then the task of identifying which causal mechanism changed. In real-world applications, one often has either few or only a single sample from the post-intervention distribution: a severe limitation for most methods, which assume one knows or can estimate the distribution. However, even those that do not are statistically ill-posed due to the need to probe regression models in regions of low probability density. In this paper, we propose simple, efficient methods to overcome both difficulties in the case where there is a single root cause and the causal graph is a polytree. When one knows the causal graph, we give guarantees for a traversal algorithm that requires only marginal anomaly scores and does not depend on specifying an arbitrary anomaly score cut-off. When one does not know the causal graph, we show that the heuristic of identifying root causes as the variables with the highest marginal anomaly scores is causally justified. To this end, we prove that anomalies with small scores are unlikely to cause those with larger scores in polytrees and give upper bounds for the likelihood of causal pathways with non-monotonic anomaly scores.

William Roy Orchard, Nastaran Okati, Sergio Hernan Garrido Mejia, Patrick Bl\"obaum, Dominik Janzing• 2024

Related benchmarks

TaskDatasetResultRank
Root Cause AnalysisRCAEval Overall All nine datasets (RE1OB-RE3TT) 1.0
Top-1 Accuracy11
9
Root Cause AnalysisRE2TT (Train Ticket with multimodal data)
CPU Top-10.07
9
Root Cause AnalysisRE3OB Online Boutique with code-level faults
F1 Top-1 Accuracy22
9
Root Cause AnalysisRE3TT Train Ticket with code-level faults
F1@10.00e+0
9
Root Cause AnalysisRE2SS Sock Shop with multimodal data (test)
CPU Top-1 Accuracy27
8
Root Cause AnalysisRE1OB (Online Boutique) RCAEval benchmark unimodal data
CPU Top-1 Acc8
8
Root Cause AnalysisRE1SS (Sock Shop) unimodal data
CPU Top-116
8
Root Cause AnalysisRE1TT Train Ticket unimodal data
CPU Top-10.00e+0
8
Root Cause AnalysisRE3SS Sock Shop with code-level faults
F1 Top-10.1
8
Showing 9 of 9 rows

Other info

Follow for update