| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| SugarCrepe (test) | DataComp (xlarge) | Replace (Object)95.52 | 20 | 4d ago | |
| SugarCrepe swap att (test) | DeGLA | Accuracy82.1 | 13 | 4d ago | |
| ARO-A (test) | ABE-FG-CLIP | Accuracy84.49 | 13 | 4d ago | |
| ABC-6K (test) | ABE-FG-CLIP | Accuracy0.8553 | 12 | 4d ago | |
| Winoground Txt2Img | IL-CLIP | Txt2Img Score14 | 4 | 4d ago | |
| CoLA Txt2Img | CLIP | Compositional Score (Txt2Img)21 | 4 | 4d ago | |
| CREPE productivity (test) | IL-CLIP | Replace Rate0.14 | 4 | 4d ago | |
| CREPE systematicity (test) | Codebook-CLIP | Atom Score34 | 4 | 4d ago |
