No Data? No Problem: Synthesizing Security Graphs for Better Intrusion Detection
About
Provenance graph analysis plays a vital role in intrusion detection, particularly against Advanced Persistent Threats (APTs), by exposing complex attack patterns. While recent systems combine graph neural networks (GNNs) with natural language processing (NLP) to capture structural and semantic features, their effectiveness is limited by class imbalance in real-world data. To address this, we introduce PROVSYN, a novel hybrid provenance graph synthesis framework, which comprises three components: (1) graph structure synthesis via heterogeneous graph generation models, (2) textual attribute synthesis via fine-tuned Large Language Models (LLMs), and (3) five-dimensional fidelity evaluation. Experiments on six benchmark datasets demonstrate that PROVSYN consistently produces higher-fidelity graphs across the five evaluation dimensions compared to four strong baselines. To further demonstrate the practical utility of PROVSYN, we utilize the synthesized graphs to augment training datasets for downstream APT detection models. The results show that PROVSYN effectively mitigates data imbalance, improving normalized entropy by up to 35%, and enhances the generalizability of downstream detection models, achieving an accuracy improvement of up to 38%.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Textual Quality Evaluation | Cadets E3 (test) | GLEU56 | 10 | |
| Textual Quality Evaluation | Theia E3 (test) | GLEU69 | 10 | |
| Textual Quality Evaluation | Theia E5 (test) | GLEU18 | 10 | |
| Textual Quality Evaluation | OpTC H201 (test) | GLEU55 | 10 | |
| Textual Quality Evaluation | OpTC H501 (test) | GLEU38 | 10 | |
| Textual Quality Evaluation | ClearScope E5 (test) | GLEU52 | 10 | |
| Intrusion Detection | CADETS E3 | -- | 10 | |
| Intrusion Detection | THEIA E3 | -- | 9 | |
| Intrusion Detection | Clearscope-E5 | F-Score174.8 | 8 | |
| Intrusion Detection | Theia-E5 | F-Score56.34 | 8 |