Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FashionIQ

Benchmarks

Task NameDataset NameSOTA ResultTrend
Composed Image RetrievalFashionIQ (val)
Average Recall@1058.16
653
Composed Image RetrievalFashionIQ Shirt
Recall@1061.91
92
Composed Image RetrievalFashionIQ (Dress)
Recall@1052.91
67
Compositional Image RetrievalFashionIQ 1.0 (val)
Average Recall@1043.49
42
Composed Image RetrievalFashionIQ Toptee
Recall@1050.48
41
Composed Image Retrieval (Image-Text to Image)FashionIQ
Recall@1057.2
39
Composed Image RetrievalFashionIQ Tops&Tees
R@1063.27
26
Compositional Image RetrievalFashionIQ (val)
Recall@10 (Shirt)41.07
23
Composed Image RetrievalFashionIQ 1.0 (test)
R@1045.7
20
Multi-Target RetrievalFashionIQ Average
mAP@545.5
14
Composed Image RetrievalFashionIQ Zero-Shot
Average R@103,681
13
Composed Image RetrievalFashionIQ Tops&Tees (test)
R@1064.67
12
Composed Image RetrievalFashionIQ Shirts (test)
Recall@1059.81
12
Composed Image RetrievalFashionIQ Dresses (test)
Recall@1053.13
12
Composed Image RetrievalFashionIQ Dress, Shirt, Toptee
Dress Recall@1033.65
12
Multi-round Interleaved RetrievalMulti-round FashionIQ (unseen)
Recall@561.2
9
Dialog-based Image RetrievalFashionIQ Multi-round
R@563.9
9
Interactive Composed Image RetrievalFashionIQ
Recall@10 (T0)37.6
6
Composed Visual RetrievalMulti-Turn FashionIQ (test)
Recall@5 (Dresses)48.3
6
Composed Image RetrievalMulti-Target FashionIQ (val)
mAP@5 (Shirt)42.45
4
Showing 20 of 20 rows