Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FlowCLAS: Enhancing Normalizing Flow Via Contrastive Learning For Anomaly Segmentation

About

Anomaly segmentation is an essential capability for safety-critical robotics applications that must be aware of unexpected events. Normalizing flows (NFs), a class of generative models, are a promising approach for this task due to their ability to model the inlier data distribution efficiently. However, their performance falters in dynamic scenes, where complex, multi-modal data distributions cause them to struggle with identifying out-of-distribution samples, leaving a performance gap to leading discriminative methods. To address this limitation, we introduce FlowCLAS, a hybrid framework that enhances the traditional maximum likelihood objective of NFs with a discriminative, contrastive loss. Leveraging Outlier Exposure, this objective explicitly enforces a separation between normal and anomalous features in the latent space, retaining the probabilistic foundation of NFs while embedding the discriminative power they lack. The strength of this approach is demonstrated by FlowCLAS establishing new state-of-the-art (SOTA) performance across multiple challenging anomaly segmentation benchmarks for robotics, including Fishyscapes Lost & Found, Road Anomaly, SegmentMeIfYouCan-ObstacleTrack, and ALLO. Our experiments also show that this contrastive approach is more effective than other outlier-based training strategies for NFs, successfully bridging the performance gap to leading discriminative methods. Project page: https://trailab.github.io/FlowCLAS

Chang Won Lee, Selina Leveugle, Svetlana Stolpner, Chris Langley, Paul Grouchy, Jonathan Kelly, Steven L. Waslander• 2024

Related benchmarks

TaskDatasetResultRank
Anomaly SegmentationFishyscapes Lost & Found (val)
FPR950.7
74
Anomaly SegmentationRoad Anomaly (val)
FPR953.3
17
Anomaly SegmentationSegmentMeIfYouCan Obstacle Track
AUPRC94.2
9
Anomaly SegmentationSegmentMeIfYouCan Anomaly Track
AUPRC94.3
9
Space anomaly segmentationALLO (test)
AUPRC88.4
8
Showing 5 of 5 rows

Other info

Follow for update