Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NegBench

Benchmarks

Task NameDataset NameSOTA ResultTrend
MCQ-NegNegBench
Affirmed Accuracy84.55
25
Negative RetrievalNegBench
Image-to-Text Recall@164.62
25
Vision-Language UnderstandingNegBench VOC2007
Accuracy95.37
11
Vision-Language UnderstandingNegBench COCO
Accuracy93.19
11
Multiple Choice Visual Question AnsweringNegBench VOC 2007 (test)
Accuracy95.37
11
Multiple Choice Visual Question AnsweringNegBench COCO (test)
Accuracy93.19
11
Multiple Choice QuestionNegBench COCO subset
Overall Accuracy32.55
4
Showing 7 of 7 rows