Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Global Logic and Local Search: Dual-Stream Multimodal In-Context Learning for Verifiable Industrial Anomaly Detection

About

Large Multimodal Models (LMMs) show strong few-shot generalization, but industrial anomaly detection remains difficult because defects are small, input resolution is limited, and textual standards are not always grounded in visual evidence. Recent optimization-based methods improve alignment through fine-tuning, but they often require many defective samples, which are unavailable in early deployment. We present Global Logic and Local Search (GLLS), a training-free framework for reference-guided multimodal in-context verification. GLLS uses a Part-Aware Visual-Logical Atlas to organize normal references and structured specifications in the inference context. It combines a Global & Logic Stream, where SAM 3 extracts partially checkable visual facts, with a Fine-Grained & Actions Stream, where MCTS selects local evidence crops under a fixed budget. Experiments on MMAD-QA and additional anomaly detection datasets show consistent gains over matched and general-purpose baselines, while keeping the final diagnostic decision traceable to explicit visual evidence throughout the inspection trace.

Runzhi Deng, Yundi Hu, Yiming Zhong, Zhao Wang, Xixi Liu, Hongsong Wang, Caifeng Shan, Fang Zhao• 2026

Related benchmarks

TaskDatasetResultRank
Anomaly ReasoningMMAD
Average Score91.2
38
Industrial Anomaly DetectionMPDD (test)
Accuracy80.23
22
Industrial Anomaly DetectionDAGM (test)
Accuracy97.48
22
Industrial Anomaly DetectionDTD (test)
Accuracy95.31
22
Anomaly Detection Question AnsweringMMAD VisA domain
Discrimination Score88.2
19
Showing 5 of 5 rows

Other info

Follow for update