Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SeaS: Few-shot Industrial Anomaly Image Generation with Separation and Sharing Fine-tuning

About

We introduce SeaS, a unified industrial generative model for automatically creating diverse anomalies, authentic normal products, and precise anomaly masks. While extensive research exists, most efforts either focus on specific tasks, i.e., anomalies or normal products only, or require separate models for each anomaly type. Consequently, prior methods either offer limited generative capability or depend on a vast array of anomaly-specific models. We demonstrate that U-Net's differentiated learning ability captures the distinct visual traits of slightly-varied normal products and diverse anomalies, enabling us to construct a unified model for all tasks. Specifically, we first introduce an Unbalanced Abnormal (UA) Text Prompt, comprising one normal token and multiple anomaly tokens. More importantly, our Decoupled Anomaly Alignment (DA) loss decouples anomaly attributes and binds them to distinct anomaly tokens of UA, enabling SeaS to create unseen anomalies by recombining these attributes. Furthermore, our Normal-image Alignment (NA) loss aligns the normal token to normal patterns, making generated normal products globally consistent and locally varied. Finally, SeaS produces accurate anomaly masks by fusing discriminative U-Net features with high-resolution VAE features. SeaS sets a new benchmark for industrial generation, significantly enhancing downstream applications, with average improvements of $+8.66\%$ pixel-level AP for synthesis-based AD approaches, $+1.10\%$ image-level AP for unsupervised AD methods, and $+12.79\%$ IoU for supervised segmentation models. Code is available at \href{https://github.com/HUST-SLOW/SeaS}{https://github.com/HUST-SLOW/SeaS}.

Zhewei Dai, Shilei Zeng, Haotian Liu, Xurui Li, Feng Xue, Yu Zhou• 2024

Related benchmarks

TaskDatasetResultRank
Anomaly LocalizationMVTec AD
Pixel AUROC99.9
513
Anomaly DetectionMVTec-AD (test)
I-AUROC99
327
Image-level Anomaly DetectionMVTec-AD (test)--
86
Anomaly GenerationMVTec AD
KID34.47
85
Image-level Anomaly DetectionMVTec AD
AUROC98.73
82
Image-level Anomaly DetectionVisA
AUC91.31
80
Anomaly DetectionMVTec AD
AP-I100
80
Image-level Anomaly DetectionVisA (test)
AP (Image)99.3
75
Anomaly Detection and LocalizationVisA (test)
P-AUROC99.9
70
Anomaly GenerationVisA
IC-LPIPS10
62
Showing 10 of 33 rows

Other info

Follow for update