IstGPT: LLM-based Anomaly Detection for Spatial-Temporal Graph in Industrial Systems
About
Industrial Internet systems face increasing threats from sophisticated industrial control system (ICS) attacks, resulting in critical safety incidents. However, existing tools exhibit limited effectiveness in real-time anomaly detection due to the complex dependencies among sensors and actuators. To tackle this, we present IstGPT, the first industrial anomaly detection tool based on LLMs and graph learning to provide real-time protection against a wide range of ICS attacks. IstGPT achieves fine-grained and precise modeling on spatial-temporal dependencies in industrial cyber-physical systems. It first leverages industrial multi-modal knowledge, including operational data, technical documents, and system diagrams, to extract sensor-actuator dependency graphs via multi-stage prompt engineering. Then, LLM-Optimation iteratively refines the graph based on node accuracy, edge consistency, and logical coherence. Finally, IstGPT integrated improved graph neural networks with an encoder-decoder architecture to detect anomalies via reconstruction errors. We evaluate IstGPT against 12 state-of-the-art baselines on 9 datasets, including 2 public, 6 simulated, and a real-world robotic arm dataset. IstGPT achieves the best F1-scores and eTaF1 (a newer time-aware metric) across nine datasets. We further discuss the feasibility of deploying IstGPT in real-world industrial scenarios.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Anomaly Detection | WADI | Training Time (s/epoch)5.04e+3 | 24 | |
| Anomaly Detection | Sim-Palletizer | Precision94.3 | 13 | |
| Anomaly Detection | Sim-Sorting by Height Basic | Precision94.6 | 13 | |
| Anomaly Detection | Sim-Sorting by Weight | Precision96.2 | 13 | |
| Anomaly Detection | Sim-Sorting by Height Advanced | Precision81.3 | 13 | |
| Anomaly Detection | SWaT | Precision (Pre)97.7 | 13 | |
| Anomaly Detection | Real-world robotic arm | Precision89.5 | 13 | |
| Anomaly Detection | Sim-Converge Station | Precision85.7 | 13 | |
| Anomaly Detection | Sim-Level Control | Precision82.4 | 13 | |
| Anomaly Detection | Simulation | Average Time Cost9.3 | 13 |