| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| MS COCO Karpathy (test) | PaLI | CIDEr149.1 | 682 | 1mo ago | |
| COCO | Method [48] | CIDEr154.9 | 130 | 19d ago | |
| MS COCO (test) | VinVLbase | CIDEr140.4 | 120 | 1mo ago | |
| nocaps (val) | GIT2 | CIDEr (Overall)126.9 | 115 | 16d ago | |
| Flickr30K | LION-12B | CIDEr Score87.12 | 111 | 1mo ago | |
| Flickr30k (test) | Blended | CIDEr98.3 | 103 | 1mo ago | |
| NoCaps | PALI-17B | CIDEr127 | 101 | 1mo ago | |
| TextCaps | PaLI-3 | CIDEr164.3 | 96 | 1mo ago | |
| Flickr30K (Karpathy split) | InstructBLIP | CIDEr123.1 | 76 | 1mo ago | |
| COCO (Karpathy split) | mPLUG | CIDEr155.1 | 74 | 1mo ago | |
| MS-COCO | OFA | CIDEr154.9 | 69 | 4d ago | |
| MS-COCO online (test) | GRIT | BLEU-4 (c5)42.5 | 64 | 1mo ago | |
| NoCaps (test) | CogVLM | CIDEr (overall)126.4 | 61 | 1mo ago | |
| MS COCO (Karpathy) | VinVL_large | CIDEr-D140.9 | 56 | 1mo ago | |
| Flickr30k | InstructBLIP | CIDEr84.5 | 55 | 1mo ago | |
| COCO Caption | SimVLM | CIDEr143.3 | 55 | 1mo ago | |
| TextCaps (val) | PaLI-X | CIDEr163.7 | 51 | 1mo ago | |
| POPE Adversarial | CIDEr121.4 | 50 | 1mo ago | ||
| TextCaps (test) | PaLI-3 | CIDEr164.3 | 50 | 1mo ago | |
| COCO 2014 (test) | MM1-30B | CIDEr125.3 | 44 | 1mo ago | |
| MS-COCO 2014 (test) | OFA | BLEU-478.7 | 43 | 1mo ago | |
| COCO (test) | GIT2 | CIDEr149.8 | 43 | 1mo ago | |
| IIW-400 | CapMAS | Precision84.2 | 40 | 3d ago | |
| RSICD | SkyEyeGPT | BLEU-460 | 37 | 1mo ago | |
| MS COCO | CLIPScore0.865 | 36 | 16d ago |
