| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| NLVR2 (test-p) | BEIT-3 | Accuracy92.6 | 327 | 3d ago | |
| NLVR2 (dev) | BEIT-3 | Accuracy91.51 | 288 | 3d ago | |
| NLVR2 (test) | I2M2 | Accuracy85.36 | 16 | 3d ago | |
| NLVR2 | Ours (masked) (LLaVA-OV-7B) | Accuracy87.3 | 15 | 2d ago | |
| NLVR2 std | X-VLM | Accuracy85.5 | 14 | 3d ago | |
| NLVR2 (val) | X-VLMclip | Accuracy83.15 | 12 | 3d ago | |
| NLVR2 | PuMer | GFLOPs17.4 | 4 | 3d ago | |
| NLVR2 (test-u) | VisualBERT | Accuracy67.3 | 2 | 3d ago |