Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Learning Conditional Attributes for Compositional Zero-Shot Learning

About

Compositional Zero-Shot Learning (CZSL) aims to train models to recognize novel compositional concepts based on learned concepts such as attribute-object combinations. One of the challenges is to model attributes interacted with different objects, e.g., the attribute ``wet" in ``wet apple" and ``wet cat" is different. As a solution, we provide analysis and argue that attributes are conditioned on the recognized object and input image and explore learning conditional attribute embeddings by a proposed attribute learning framework containing an attribute hyper learner and an attribute base learner. By encoding conditional attributes, our model enables to generate flexible attribute embeddings for generalization from seen to unseen compositions. Experiments on CZSL benchmarks, including the more challenging C-GQA dataset, demonstrate better performances compared with other state-of-the-art approaches and validate the importance of learning conditional attributes. Code is available at https://github.com/wqshmzh/CANet-CZSL

Qingsheng Wang, Lingqiao Liu, Chenchen Jing, Hao Chen, Guoqiang Liang, Peng Wang, Chunhua Shen• 2023

Related benchmarks

TaskDatasetResultRank
Compositional Zero-Shot LearningC-GQA open world
HM Score11.96
65
Compositional Zero-Shot LearningUT-Zappos Closed World
HM47.3
57
Compositional Zero-Shot LearningC-GQA Closed World
HM14.5
56
Generalized Compositional Zero-Shot LearningC-GQA (test)
AUC3.3
46
Compositional Zero-Shot LearningMIT-States Closed World
Harmonic Mean (HM)0.179
32
Compositional Zero-Shot LearningVAW CZSL (test)
HM11.21
30
Compositional Zero-Shot LearningMIT-States open-vocabulary
HM10.52
16
Compositional Zero-Shot LearningUT-Zappos50K (test)
Seen Accuracy61
8
Continual Compositional Zero-Shot LearningUT-Zappos
AUC Session 045.48
8
Continual Compositional Zero-Shot LearningC-GQA (test)
AUC (Session 0)5.17
7
Showing 10 of 10 rows

Other info

Code

Follow for update