Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MSCOCO

Benchmarks

Task NameDataset NameSOTA ResultTrend
Text-to-Image RetrievalMSCOCO 5K (test)
R@160.9
286
Image-to-text retrievalMSCOCO
R@181.9
124
Text-to-image retrievalMSCOCO
R@164.3
118
Visual Hallucination EvaluationMSCOCO
CHAIR_i18.2
104
Text-to-Image RetrievalMSCOCO 1K (test)
R@16,390
104
Sentence RetrievalMSCOCO 5k (test)
R@180.9
67
Object Hallucination EvaluationMSCOCO 2014 (val)
CHAIRs54.6
55
Object HallucinationMSCOCO 500 images 2014 (val)
Consistency Score (CS)60.6
50
Image-to-text retrievalMSCOCO 5K (test)
R@184.8
46
Object DetectionMSCOCO (val)
AP61.3
43
Text-to-image RetrievalMSCOCO (5K)
R@153.98
42
Pointing gameMSCOCO 2014 (val)
Mean Accuracy (All)69.9
42
Text-to-Image GenerationMSCOCO 30K
FID6.61
42
Image RetrievalMSCOCO @5000 (test)
mAP87.27
39
Object Hallucination AssessmentMSCOCO
CHAIR Instance Score30.2
38
Hallucination EvaluationMSCOCO (val)
CHAIR_i23.04
36
Object DetectionMSCOCO 2017 (val)
APb47.5
33
Image-to-Text RetrievalMSCOCO (test)
R@594.5
33
Image-to-text RetrievalMSCOCO (5K)
R@177.8
33
Text-to-Image synthesisMSCOCO
FID6.95
31
Text RetrievalMSCOCO (test)
TR@177.6
31
Image RetrievalMSCOCO (test)
IR@160.7
31
Image CaptioningMSCOCO (test)
CIDEr149.6
29
Text RetrievalMSCOCO (5K)
R@183.2
29
Text-to-image retrievalMSCOCO 48 (test)
R@152.5
28
Showing 25 of 158 rows