Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Finding any Waldo: zero-shot invariant and efficient visual search

About

Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, and must generalize to locate novel target objects with zero-shot training. Previous work has focused on searching for perfect matches of a target after extensive category-specific training. Here we show for the first time that humans can efficiently and invariantly search for natural objects in complex scenes. To gain insight into the mechanisms that guide visual search, we propose a biologically inspired computational model that can locate targets without exhaustive sampling and generalize to novel objects. The model provides an approximation to the mechanisms integrating bottom-up and top-down signals during search in natural scenes.

Mengmi Zhang, Jiashi Feng, Keng Teck Ma, Joo Hwee Lim, Qi Zhao, Gabriel Kreiman• 2018

Related benchmarks

TaskDatasetResultRank
Scanpath PredictionCOCO-Search18 target-present (test)
SemSS0.368
10
Target-absent search scanpath predictionCOCO-Search18 target-absent (test)
SemSS0.279
10
ForagingForaging USetSize (OOD)
Normalized Score7.78e+3
5
ForagingForaging EqVal UnPre (OOD)
Normalized Score76.03
5
ForagingForaging UValues (OOD)
Norm Score4.76e+3
5
ForagingOOD Foraging UItemNum
NormScore4.72e+3
5
Showing 6 of 6 rows

Other info

Follow for update