Root Cause Analysis of Outliers with Missing Structural Knowledge
About
The goal of Root Cause Analysis (RCA) is to explain why an anomaly occurred by identifying where the fault originated. Several recent works model the anomalous event as resulting from a change in the causal mechanism at the root cause, i.e., as a soft intervention. RCA is then the task of identifying which causal mechanism changed. In real-world applications, one often has either few or only a single sample from the post-intervention distribution: a severe limitation for most methods, which assume one knows or can estimate the distribution. However, even those that do not are statistically ill-posed due to the need to probe regression models in regions of low probability density. In this paper, we propose simple, efficient methods to overcome both difficulties in the case where there is a single root cause and the causal graph is a polytree. When one knows the causal graph, we give guarantees for a traversal algorithm that requires only marginal anomaly scores and does not depend on specifying an arbitrary anomaly score cut-off. When one does not know the causal graph, we show that the heuristic of identifying root causes as the variables with the highest marginal anomaly scores is causally justified. To this end, we prove that anomalies with small scores are unlikely to cause those with larger scores in polytrees and give upper bounds for the likelihood of causal pathways with non-monotonic anomaly scores.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Root Cause Analysis | RCAEval Overall All nine datasets (RE1OB-RE3TT) 1.0 | Top-1 Accuracy11 | 9 | |
| Root Cause Analysis | RE2TT (Train Ticket with multimodal data) | CPU Top-10.07 | 9 | |
| Root Cause Analysis | RE3OB Online Boutique with code-level faults | F1 Top-1 Accuracy22 | 9 | |
| Root Cause Analysis | RE3TT Train Ticket with code-level faults | F1@10.00e+0 | 9 | |
| Root Cause Analysis | RE2SS Sock Shop with multimodal data (test) | CPU Top-1 Accuracy27 | 8 | |
| Root Cause Analysis | RE1OB (Online Boutique) RCAEval benchmark unimodal data | CPU Top-1 Acc8 | 8 | |
| Root Cause Analysis | RE1SS (Sock Shop) unimodal data | CPU Top-116 | 8 | |
| Root Cause Analysis | RE1TT Train Ticket unimodal data | CPU Top-10.00e+0 | 8 | |
| Root Cause Analysis | RE3SS Sock Shop with code-level faults | F1 Top-10.1 | 8 |