Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

METANOIA: A Lifelong Intrusion Detection and Investigation System for Mitigating Concept Drift

About

As Advanced Persistent Threat (APT) complexity increases, provenance data is increasingly used for detection. Anomaly-based systems are gaining attention due to their attack-knowledge-agnostic nature and ability to counter zero-day vulnerabilities. However, traditional detection paradigms, which train on offline, limited-size data, often overlook concept drift - unpredictable changes in streaming data distribution over time. This leads to high false positive rates. We propose incremental learning as a new paradigm to mitigate this issue. However, we identify FOUR CHALLENGES while integrating incremental learning as a new paradigm. First, the long-running incremental system must combat catastrophic forgetting (C1) and avoid learning malicious behaviors (C2). Then, the system needs to achieve precise alerts (C3) and reconstruct attack scenarios (C4). We present METANOIA, the first lifelong detection system that mitigates the high false positives due to concept drift. It connects pseudo edges to combat catastrophic forgetting, transfers suspicious states to avoid learning malicious behaviors, filters nodes at the path-level to achieve precise alerts, and constructs mini-graphs to reconstruct attack scenarios. Using state-of-the-art benchmarks, we demonstrate that METANOIA improves precision performance at the window-level, graph-level, and node-level by 30%, 54%, and 29%, respectively, compared to previous approaches.

Jie Ying, Mengce Zheng, Jungan Chen, Ruoxi Chen, Zhongjie Zhua, Tiantian Zhu• 2024

Related benchmarks

TaskDatasetResultRank
Graph-level attack detectionE3-CADETS
Precision80
3
Graph-level attack detectionE3-THEIA
Precision100
3
Graph-level attack detectionE3-ClearScope
Precision100
3
Anomaly DetectionE3-CADETS
True Positives (TP)11
2
Anomaly DetectionE3-ClearScope
True Positives2
2
Anomaly DetectionTHEIA E3
True Positives (TP)9
2
Anomaly DetectionE5-THEIA
True Positives (TP)2
2
Node-level Anomaly DetectionDARPA TC CADETS E3
Precision100
2
Node-level Anomaly DetectionDARPA TC E3-THEIA
Precision100
2
Node-level Anomaly DetectionDARPA TC CADETS E5
Precision100
2
Showing 10 of 13 rows

Other info

Follow for update