Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Synthetic Sample Selection for Generalized Zero-Shot Learning

About

Generalized Zero-Shot Learning (GZSL) has emerged as a pivotal research domain in computer vision, owing to its capability to recognize objects that have not been seen during training. Despite the significant progress achieved by generative techniques in converting traditional GZSL to fully supervised learning, they tend to generate a large number of synthetic features that are often redundant, thereby increasing training time and decreasing accuracy. To address this issue, this paper proposes a novel approach for synthetic feature selection using reinforcement learning. In particular, we propose a transformer-based selector that is trained through proximal policy optimization (PPO) to select synthetic features based on the validation classification accuracy of the seen classes, which serves as a reward. The proposed method is model-agnostic and data-agnostic, making it applicable to both images and videos and versatile for diverse applications. Our experimental results demonstrate the superiority of our approach over existing feature-generating methods, yielding improved overall performance on multiple benchmarks.

Shreyank N Gowda• 2023

Related benchmarks

TaskDatasetResultRank
Action RecognitionUCF101
Accuracy40.9
365
Image ClassificationCUB
Unseen Top-1 Acc67.7
89
Image ClassificationSUN
Harmonic Mean Top-1 Accuracy46.4
86
Image ClassificationAWA1
Test Set Score (ts)64.6
30
Image ClassificationFLO
Top-1 Accuracy (Unseen)86.3
17
Image ClassificationSUN (unseen)
Accuracy66
16
Image ClassificationAWA1 (unseen)
Accuracy73.1
12
Action RecognitionHMDB51
Harmonic Mean Acc39.8
10
Action RecognitionUCF101
Harmonic Mean Acc51.8
10
Action RecognitionHMDB51
Mean Class Accuracy35.9
10
Showing 10 of 15 rows

Other info

Follow for update