CREPE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Compositionality Evaluation | CREPE | CU92.6 | 14 | |
| Image-to-Text retrieval | CREPE (test) | Multi-Obj Acc0.8735 | 13 | |
| Image-to-text retrieval | CREPE productivity | R@1 (replace)17.9 | 8 | |
| Image-to-text retrieval | CREPE systematicity CC12M | R@1 (atom)36.6 | 8 | |
| Text-image retrieval | CREPE | NDCG@1073.56 | 6 | |
| Compositional Evaluation | CREPE productivity (test) | Replace Rate0.14 | 4 | |
| Compositional Evaluation | CREPE systematicity (test) | Atom Score34 | 4 |
Showing 7 of 7 rows