Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Look Inside for More: Internal Spatial Modality Perception for 3D Anomaly Detection

About

3D anomaly detection has recently become a significant focus in computer vision. Several advanced methods have achieved satisfying anomaly detection performance. However, they typically concentrate on the external structure of 3D samples and struggle to leverage the internal information embedded within samples. Inspired by the basic intuition of why not look inside for more, we introduce a straightforward method named Internal Spatial Modality Perception~(ISMP) to explore the feature representation from internal views fully. Specifically, our proposed ISMP consists of a critical perception module, Spatial Insight Engine~(SIE), which abstracts complex internal information of point clouds into essential global features. Besides, to better align structural information with point data, we propose an enhanced key point feature extraction module for amplifying spatial structure feature representation. Simultaneously, a novel feature filtering module is incorporated to reduce noise and redundant features for further aligning precise spatial structure. Extensive experiments validate the effectiveness of our proposed method, achieving object-level and pixel-level AUROC improvements of 3.2\% and 13.1\%, respectively, on the Real3D-AD benchmarks. Note that the strong generalization ability of SIE has been theoretically proven and is verified in both classification and segmentation tasks.

Hanzhe Liang, Guoyang Xie, Chengbin Hou, Bingshu Wang, Can Gao, Jinbao Wang• 2024

Related benchmarks

TaskDatasetResultRank
Object-level Anomaly DetectionAnomaly-ShapeNet (test)
ashtray086.5
49
3D Anomaly DetectionReal3D-AD
Average O-AUROC0.757
33
Anomaly DetectionAnomaly-ShapeNet v1 (test)
Cap 0 AUROC0.865
26
Point-level 3D Anomaly DetectionAnomaly-ShapeNet (test)
P-AUROC69.1
10
3D Anomaly DetectionReal3D-AD v1 (test)
Airplane Score0.753
9
Anomaly DetectionReal3D-AD (test)
Airplane Score85.8
9
Anomaly LocalizationReal3D-AD (test)
P-AUROC (Airplane)0.753
7
Showing 7 of 7 rows

Other info

Follow for update