Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Determined by User Needs: A Salient Object Detection Rationale Beyond Conventional Visual Stimuli

About

Existing \textbf{s}alient \textbf{o}bject \textbf{d}etection (SOD) methods adopt a \textbf{passive} visual stimulus-based rationale--objects with the strongest visual stimuli are perceived as the user's primary focus (i.e., salient objects). They ignore the decisive role of users' \textbf{proactive needs} in segmenting salient objects--if a user has a need before seeing an image, the user's salient objects align with their needs, e.g., if a user's need is ``white apple'', when this user sees an image, the user's primary focus is on the ``white apple'' or ``the most white apple-like'' objects in the image. Such an oversight not only \textbf{fails to satisfy users}, but also \textbf{limits the development of downstream tasks}. For instance, in salient object ranking tasks, focusing solely on visual stimuli-based salient objects is insufficient for conducting an analysis of fine-grained relationships between users' viewing order (usually determined by user's needs) and scenes, which may result in wrong ranking results. Clearly, it is essential to detect salient objects based on user needs. Thus, we advocate a \textbf{User} \textbf{S}alient \textbf{O}bject \textbf{D}etection (UserSOD) task, which focuses on \textbf{detecting salient objects align with users' proactive needs when user have needs}. The main challenge for this new task is the lack of datasets for model training and testing.

Chenglizhao Chen, Shujian Zhang, Luming Li, Wenfeng Song, Shuai Li• 2026

Related benchmarks

TaskDatasetResultRank
Salient Object DetectionECSSD
MAE0.021
222
Salient Object DetectionPASCAL-S
MAE0.045
196
Salient Object DetectionHKU-IS
MAE0.021
175
Salient Object DetectionDUTS
F-beta Score95.7
42
Salient Object DetectionUserSOD (test)
MAE0.049
18
Referring Image SegmentationRefCOCO--
11
Referring Image SegmentationRefCOCO+--
11
User Satisfaction EvaluationUser Study Shopping
Average Satisfaction Score79.36
10
User Satisfaction EvaluationUser Study Navigation
Average Score85.07
10
User Satisfaction EvaluationUser Study Industry
Average Score55.01
10
Showing 10 of 10 rows

Other info

Follow for update