| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Composite | HarmonicEval | Kendall-c Tau_c66.2 | 131 | 12d ago | |
| Flickr8k-CF | ITIScore | Kendall-b Correlation (tau_b)56.6 | 99 | 12d ago | |
| Flickr8k Expert | Pomms | Kendall Tau-c (tau_c)60.8 | 82 | 4d ago | |
| Flickr8K Expert (test) | Polos | Kendall tau_c56.4 | 76 | 1mo ago | |
| Pascal-50S (test) | Polos | HC70 | 66 | 1mo ago | |
| Flickr8K-CF (test) | RefFLEUR | Kendall tau_b38.8 | 65 | 1mo ago | |
| Pascal-50S | DENEB | Accuracy87.8 | 44 | 1mo ago | |
| ICBench Long Caption | Human Score76.57 | 40 | 12d ago | ||
| Nebula | Pearl | Kendall tau_c55.4 | 31 | 4d ago | |
| THumb (test) | CLIP + DN*-ref | tau_c26.2 | 18 | 1mo ago | |
| COMPOSITE (COM) (test) | RefFLEUR | Kendall's tau-c64.2 | 17 | 1mo ago | |
| THumB w/ Human 1.0 | RefCLIP-S | Precision31 | 16 | 1mo ago | |
| THumB w/o Human 1.0 | RefCLIP-S | Precision34 | 16 | 1mo ago | |
| LongCap-Arena (test) | ITIScore | Fluency42.3 | 15 | 12d ago | |
| MMHE (test) | ITIScore | Fluency Score51.3 | 15 | 12d ago | |
| MCEval 1.0 (test) | DISCODE | Real Style Score87.8 | 12 | 1mo ago | |
| FOIL | RefFLEUR | Accuracy98.4 | 10 | 1mo ago | |
| OID Rated Image Caption | Accuracy62.42 | 7 | 1mo ago | ||
| Abstract-50S | RefPAC-S | Mean Accuracy76.9 | 4 | 1mo ago |
