Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Mutually-Aware Feature Learning for Few-Shot Object Counting

About

Few-shot object counting has garnered significant attention for its practicality as it aims to count target objects in a query image based on given exemplars without additional training. However, the prevailing extract-and-match approach has a shortcoming: query and exemplar features lack interaction during feature extraction since they are extracted independently and later correlated based on similarity. This can lead to insufficient target awareness and confusion in identifying the actual target when multiple class objects coexist. To address this, we propose a novel framework, Mutually-Aware FEAture learning (MAFEA), which encodes query and exemplar features with mutual awareness from the outset. By encouraging interaction throughout the pipeline, we obtain target-aware features robust to a multi-category scenario. Furthermore, we introduce background token to effectively associate the query's target region with exemplars and decouple its background region. Our extensive experiments demonstrate that our model achieves state-of-the-art performance on FSCD-LVIS and FSC-147 benchmarks with remarkably reduced target confusion.

Yerim Jeon, Subeen Lee, Jihwan Kim, Jae-Pil Heo• 2024

Related benchmarks

TaskDatasetResultRank
Object CountingFSC-147 (test)
MAE13.23
297
Showing 1 of 1 rows

Other info

Follow for update