Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MSCOCO

Benchmarks

Task NameDataset NameSOTA ResultTrend
Text-to-Image RetrievalMSCOCO 5K (test)
R@160.9
312
Image-to-text retrievalMSCOCO
R@181.9
152
Text RetrievalMSCOCO (test)
Attack Success Rate @1100
144
Image RetrievalMSCOCO (test)
R@1 Attack Success Rate100
144
Text RetrievalMSCOCO
Recall@1100
142
Text-to-image retrievalMSCOCO
R@164.3
142
Visual Hallucination EvaluationMSCOCO
CHAIR_i18.2
122
Text-to-Image RetrievalMSCOCO 1K (test)
R@16,390
118
Object Hallucination EvaluationMSCOCO 2014 (val)
CHAIRs56.8
81
Object Hallucination EvaluationMSCOCO POPE
Random Accuracy91.63
71
Image-to-text retrievalMSCOCO 5K (test)
R@184.8
68
Sentence RetrievalMSCOCO 5k (test)
R@180.9
67
Object Hallucination EvaluationMSCOCO POPE SEEM-annotated
Accuracy91.07
60
Object DetectionMSCOCO
ASR94.5
54
Text-to-Image GenerationMSCOCO 30K
FID6.61
54
Text-to-Image RetrievalMSCOCO (val)
R@138.97
51
Image-to-Text RetrievalMSCOCO (val)
R@158.14
51
Image RetrievalMSCOCO 5-fold 1K (test)
Recall@165.7
51
Text-to-image RetrievalMSCOCO (5K)
R@153.98
51
Object HallucinationMSCOCO 500 images 2014 (val)
Consistency Score (CS)60.6
50
Text-to-Image RetrievalMSCOCO
mAP@5094
47
Object Hallucination DetectionMSCOCO
AUROC89.62
46
Text-to-Image GenerationMSCOCO 2014
FID (30k)9.29
44
Object Hallucination EvaluationMSCOCO (Random)
Accuracy91.5
43
Object Hallucination EvaluationMSCOCO
Accuracy93.87
43
Showing 25 of 229 rows
...