Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding

About

As spacecraft send back increasing amounts of telemetry data, improved anomaly detection systems are needed to lessen the monitoring burden placed on operations engineers and reduce operational risk. Current spacecraft monitoring systems only target a subset of anomaly types and often require costly expert knowledge to develop and maintain due to challenges involving scale and complexity. We demonstrate the effectiveness of Long Short-Term Memory (LSTMs) networks, a type of Recurrent Neural Network (RNN), in overcoming these issues using expert-labeled telemetry anomaly data from the Soil Moisture Active Passive (SMAP) satellite and the Mars Science Laboratory (MSL) rover, Curiosity. We also propose a complementary unsupervised and nonparametric anomaly thresholding approach developed during a pilot implementation of an anomaly detection system for SMAP, and offer false positive mitigation strategies along with other key improvements and lessons learned during development.

Kyle Hundman, Valentino Constantinou, Christopher Laporte, Ian Colwell, Tom Soderstrom• 2018

Related benchmarks

TaskDatasetResultRank
Anomaly DetectionSMD
F1 Score90.42
217
Anomaly DetectionSWaT
F1 Score61.67
174
Anomaly DetectionPSM
Visual ROC55.71
35
Time Series Anomaly DetectionSMAP
Precision89.65
32
Time Series Anomaly DetectionMSL
VUS-ROC0.6163
32
Time Series Anomaly DetectionSMAP (test)
Affiliation Precision55.25
25
Time Series Anomaly DetectionPSM (test)
Affiliation Precision57.06
25
Anomaly DetectionSMD (test)
Precision (Aff)60.12
25
Time Series Anomaly DetectionSWaT (test)
Affiliation Precision49.99
25
Time Series Anomaly DetectionUCR-AD archive
Top-1 Accuracy46.8
23
Showing 10 of 34 rows

Other info

Follow for update