Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Text-Guided Multimodal Unified Industrial Anomaly Detection

About

Industrial anomaly detection based on RGB-3D multimodal data has emerged as a mainstream paradigm for intelligent quality inspection. However, existing unsupervised methods suffer from two critical limitations: ambiguous cross-modal alignment caused by the lack of high-level semantic guidance and insufficient geometric modeling for RGB-to-3D feature mapping. To address these issues, we propose a unified multimodal industrial anomaly detection framework guided by text semantics. The framework consists of two core modules: a Geometry-Aware Cross-Modal Mapper to preserve geometric structure during modality conversion, and an Object-Conditioned Textual Feature Adaptor to align multimodal features with semantic priors. Furthermore, we establish a unified learning paradigm for multimodal industrial anomaly detection, which breaks the one-model-one-class constraint and enables accurate anomaly detection across diverse classes using a single model. Extensive experiments on the MVTec 3D-AD and Eyecandies datasets demonstrate that our method achieves state-of-the-art performance in classification and localization under unsupervised settings.

Zewen Li, Shuo Ye, Zitong Yu, Weicheng Xie, Linlin Shen• 2026

Related benchmarks

TaskDatasetResultRank
Anomaly DetectionMVTec 3D-AD 1.0 (test)--
134
Anomaly DetectionEyecandies
Mean I-AUROC98.56
38
Anomaly LocalizationEyecandies
AUPRO @30%97.37
33
Anomaly LocalizationMVTec-3D AD (test)
AUPRO@1% (bagel)46.46
6
Showing 4 of 4 rows

Other info

Follow for update