MS-COCO
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Image Captioning | MS COCO Karpathy (test) | CIDEr149.1 | 706 | |
| Object Detection | MS COCO (test-dev) | mAP@.578.5 | 677 | |
| Object Detection | MS-COCO 2017 (val) | mAP74 | 264 | |
| Text-to-Image Retrieval | MS-COCO 5K (test) | R@168.3 | 244 | |
| Object Detection | MS COCO (val) | mAP0.603 | 222 | |
| Image Retrieval | MS-COCO 5K (test) | R@167.2 | 217 | |
| Text-to-image generation | MS-COCO (val) | FID1.53 | 202 | |
| Object Hallucination Evaluation | MS-COCO (POPE Adversarial) | Accuracy87.83 | 190 | |
| Text-to-Image Retrieval | MS-COCO | R@165.7 | 187 | |
| Text Retrieval | MS-COCO 5K (test) | R@184.8 | 182 | |
| Image Retrieval | MS-COCO | R@1100 | 172 | |
| Image-to-Text Retrieval | MS-COCO | R@180.5 | 168 | |
| Object Hallucination Evaluation | MS-COCO POPE (Popular) | Accuracy90.76 | 158 | |
| Text-to-image Generation | MS-COCO | FID4.52 | 145 | |
| Text-to-image generation | MS-COCO 2014 (val) | FID2.47 | 143 | |
| Object Detection | MS COCO novel classes | nAP2,450 | 132 | |
| Text-to-Image Generation | MS-COCO 2017 (val) | FID19.2591 | 131 | |
| Image Retrieval | MS-COCO 1K (test) | R@180.1 | 128 | |
| Object Detection | MS COCO novel classes 2017 (val) | AP22.73 | 123 | |
| Object Hallucination Evaluation | MS-COCO POPE Random | Accuracy92.36 | 121 | |
| Image-to-Text Retrieval | MS-COCO 1K (test) | R@182 | 121 | |
| Image Captioning | MS COCO (test) | CIDEr140.4 | 120 | |
| Instance Segmentation | MS COCO | mAP Mask47.9 | 111 | |
| Image Retrieval | MS-COCO (test) | MAP84.08 | 98 | |
| Object Detection | MS-COCO 2017 (test) | AP53.9 | 82 |
Showing 25 of 449 rows
...