Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Attributes Grouping and Mining Hashing for Fine-Grained Image Retrieval

About

In recent years, hashing methods have been popular in the large-scale media search for low storage and strong representation capabilities. To describe objects with similar overall appearance but subtle differences, more and more studies focus on hashing-based fine-grained image retrieval. Existing hashing networks usually generate both local and global features through attention guidance on the same deep activation tensor, which limits the diversity of feature representations. To handle this limitation, we substitute convolutional descriptors for attention-guided features and propose an Attributes Grouping and Mining Hashing (AGMH), which groups and embeds the category-specific visual attributes in multiple descriptors to generate a comprehensive feature representation for efficient fine-grained image retrieval. Specifically, an Attention Dispersion Loss (ADL) is designed to force the descriptors to attend to various local regions and capture diverse subtle details. Moreover, we propose a Stepwise Interactive External Attention (SIEA) to mine critical attributes in each descriptor and construct correlations between fine-grained attributes and objects. The attention mechanism is dedicated to learning discrete attributes, which will not cost additional computations in hash codes generation. Finally, the compact binary codes are learned by preserving pairwise similarities. Experimental results demonstrate that AGMH consistently yields the best performance against state-of-the-art methods on fine-grained benchmark datasets.

Xin Lu, Shikun Chen, Yichao Cao, Xin Zhou, Xiaobo Lu• 2023

Related benchmarks

TaskDatasetResultRank
Image-to-Image RetrievalFood101
mAP83.21
95
Image RetrievalVegFru
mAP84.49
40
Image RetrievalUEC Food-256
mAP69.57
40
Image RetrievalISIA Food-500
mAP29.02
40
Image RetrievalFood2k
mAP12.64
40
Image RetrievalVireo Food-172
mAP76.56
40
Image RetrievalImageNet @1000 (val)
mAP85.68
39
Image RetrievalCIFAR-10 @1000 (test)
mAP81.48
39
Image RetrievalMSCOCO @5000 (test)
mAP70.31
39
Image RetrievalCIFAR-10 (@1000) 20%-unseen
mAP (Unseen@Unseen)77
30
Showing 10 of 15 rows

Other info

Follow for update