Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding

About

As spacecraft send back increasing amounts of telemetry data, improved anomaly detection systems are needed to lessen the monitoring burden placed on operations engineers and reduce operational risk. Current spacecraft monitoring systems only target a subset of anomaly types and often require costly expert knowledge to develop and maintain due to challenges involving scale and complexity. We demonstrate the effectiveness of Long Short-Term Memory (LSTMs) networks, a type of Recurrent Neural Network (RNN), in overcoming these issues using expert-labeled telemetry anomaly data from the Soil Moisture Active Passive (SMAP) satellite and the Mars Science Laboratory (MSL) rover, Curiosity. We also propose a complementary unsupervised and nonparametric anomaly thresholding approach developed during a pilot implementation of an anomaly detection system for SMAP, and offer false positive mitigation strategies along with other key improvements and lessons learned during development.

Kyle Hundman, Valentino Constantinou, Christopher Laporte, Ian Colwell, Tom Soderstrom• 2018

Related benchmarks

TaskDatasetResultRank
Anomaly DetectionSMD
F1 Score90.42
375
Anomaly DetectionSWaT
F1 Score61.67
348
Time Series Anomaly DetectionGECCO
VUS-ROC0.645
74
Time Series Anomaly DetectionSMAP
F1 Score89.05
48
Anomaly DetectionMSL
F176.08
47
Anomaly DetectionWADI
F1 Score2.71
44
Anomaly DetectionPSM
Visual PR45.92
44
Time Series Anomaly DetectionMSL
AUC-ROC0.6484
36
Time Series Anomaly DetectionPSM
AUC-ROC0.5129
36
Time Series Anomaly DetectionMSL
F1 Score77.21
35
Showing 10 of 45 rows

Other info

Follow for update