NLVR
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Reasoning | NLVR v1 (Test-U) | Accuracy73 | 8 | |
| Visual Question Answering | NLVR | Accuracy (NLVR)74 | 5 | |
| Semantic Parsing | NLVR (test-P) | Accuracy86.3 | 5 | |
| Semantic Parsing | NLVR (dev) | Accuracy89.6 | 5 | |
| General | NLVR2 | Score83.2 | 3 | |
| Semantic Parsing | NLVR (test-h) | Accuracy89.5 | 3 | |
| Visual Reasoning | NLVR (val) | Accuracy75.06 | 2 | |
| Visual Reasoning | NLVR (test) | Accuracy75.33 | 2 |
Showing 8 of 8 rows