| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| NLVR2 (test-p) | BEIT-3 | Accuracy92.6 | 346 | 2mo ago | |
| NLVR2 (dev) | BEIT-3 | Accuracy91.51 | 307 | 2mo ago | |
| NLVR2 | GPT-4V | Accuracy88.8 | 41 | 1mo ago | |
| NLVR2 (test) | I2M2 | Accuracy85.36 | 16 | 3mo ago | |
| NLVR2 std | X-VLM | Accuracy85.5 | 14 | 3mo ago | |
| NLVR2 (val) | X-VLMclip | Accuracy83.15 | 12 | 3mo ago | |
| NLVR2 | PuMer | GFLOPs17.4 | 4 | 3mo ago | |
| NLVR2 (test-u) | VisualBERT | Accuracy67.3 | 2 | 3mo ago |
