Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DOCCI

Benchmarks

Task NameDataset NameSOTA ResultTrend
Image-to-Text retrievalDOCCI
R@191.3
66
Text-to-Image retrievalDOCCI
Recall@193.4
66
Image-to-text retrievalDOCCI (test)
Recall@195.9
43
Image CaptioningDOCCI 500 (test)
CAPTURE64.31
32
Text-to-Image RetrievalDOCCI (val)
Recall@117.79
27
Image-to-Text RetrievalDOCCI (val)
R@152.78
27
Long-caption Cross-modal RetrievalDOCCI (test)
T2I Recall@181.12
16
Text-to-Image RetrievalDOCCI (test)
R@179.04
12
Crossmodal retrievalDOCCI
Recall@183.04
12
Text-to-Image RetrievalDOCCI-CN
Recall@184
11
Image-to-Text RetrievalDOCCI-CN
Recall@179.7
11
Zero-shot Image-Text RetrievalDOCCI
Accuracy66.2
7
Image-to-text retrievalDOCCI (full)
Recall@191.3
6
Image-Text RetrievalDOCCI
Word Dropout (p=0.3)72.92
4
Text-to-image generationDOCCI 500 random prompts (test)
FID Score24.52
3
Showing 15 of 15 rows