Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WHOOPS

Benchmarks

Task NameDataset NameSOTA ResultTrend
Scene captioningWHOOPS! (test)
CIDEr85.82
22
Scene captioningWHOOPS! RGBP seen scenes (test)
CIDEr80.46
22
Compositional Visual Question AnsweringWHOOPS! Compositional VQA
VQA BEM67.8
14
Text-to-Image AlignmentWhoops
VQAScore80.2
12
Identification of weird imagesWHOOPS
Accuracy80
9
Image CaptioningWHOOPS (test)
BLEU@431
8
Text-to-Image GenerationWhoops
CLIP Score0.296
4
Text-to-Image GenerationWhoops
HPSv2 Score0.293
2
Showing 8 of 8 rows