Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ShareGPT4V

Benchmarks

Task NameDataset NameSOTA ResultTrend
Text-to-Image RetrievalShareGPT4V
R@197.9
35
Image-to-Text RetrievalShareGPT4V
Recall@197.8
17
Text-to-Image RetrievalShareGPT4V 1k
Recall@199
11
Image-to-Text RetrievalShareGPT4V 1k
R@199.5
11
Text-to-Image RetrievalShareGPT4V 10k
Recall@194.8
9
Image-to-Text RetrievalShareGPT4V 10k
R@195.5
9
Text-to-Image RetrievalShareGPT4V (val)
R@198.5
8
Image-to-Text RetrievalShareGPT4V (val)
R@198.7
8
Image-to-Text RetrievalShareGPT4V 5,000 samples (test)
R@188.62
6
Text-to-Image RetrievalShareGPT4V 5,000 samples (test)
R@185.48
6
Long-caption Image-to-Text RetrievalShareGPT4V
Recall@190.8
4
Long-caption Text-to-Image RetrievalShareGPT4V
Recall@10.939
4
Text GenerationShareGPT4V
BLEU-147.9
3
Object Hallucination AssessmentShareGPT4V
CHAIR-S Score46.8
3
Text-to-Image GenerationShareGPT4V (val)
FID0.317
2
Showing 15 of 15 rows