Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DAS: Densely-Anchored Sampling for Deep Metric Learning

About

Deep Metric Learning (DML) serves to learn an embedding function to project semantically similar data into nearby embedding space and plays a vital role in many applications, such as image retrieval and face recognition. However, the performance of DML methods often highly depends on sampling methods to choose effective data from the embedding space in the training. In practice, the embeddings in the embedding space are obtained by some deep models, where the embedding space is often with barren area due to the absence of training points, resulting in so called "missing embedding" issue. This issue may impair the sample quality, which leads to degenerated DML performance. In this work, we investigate how to alleviate the "missing embedding" issue to improve the sampling quality and achieve effective DML. To this end, we propose a Densely-Anchored Sampling (DAS) scheme that considers the embedding with corresponding data point as "anchor" and exploits the anchor's nearby embedding space to densely produce embeddings without data points. Specifically, we propose to exploit the embedding space around single anchor with Discriminative Feature Scaling (DFS) and multiple anchors with Memorized Transformation Shifting (MTS). In this way, by combing the embeddings with and without data points, we are able to provide more embeddings to facilitate the sampling process thus boosting the performance of DML. Our method is effortlessly integrated into existing DML frameworks and improves them without bells and whistles. Extensive experiments on three benchmark datasets demonstrate the superiority of our method.

Lizhao Liu, Shangxin Huang, Zhuangwei Zhuang, Ran Yang, Mingkui Tan, Yaowei Wang• 2022

Related benchmarks

TaskDatasetResultRank
Image RetrievalCUB-200 2011
Recall@169.2
146
Image RetrievalCARS 196
Recall@187.8
98
Image RetrievalSOP
Recall@180.6
32
Cross-Domain Image RetrievalDomainNet Real to Quickdraw
Recall@139.52
16
Cross-Domain Image RetrievalDomainNet Real to Clipart
R@161.55
16
Cross-Domain Image RetrievalDomainNet Real to Sketch
Recall@151.44
16
Cross-Domain Image RetrievalDomainNet Average across domains
R@149.51
16
Cross-Domain Image RetrievalDomainNet Real to Infograph
R@132.36
16
Cross-Domain Image RetrievalDomainNet Real to Painting
R@162.7
16
Image RetrievalCars (test)
Recall@188.34
13
Showing 10 of 10 rows

Other info

Code

Follow for update