TallyQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Counting | TallyQA | Accuracy82.2 | 67 | |
| Visual Question Answering | TallyQA | Accuracy94.09 | 49 | |
| Open-ended counting | TallyQA (test) | Simple Accuracy86.2 | 14 | |
| Visual Question Answering | TallyQA complex | Accuracy77.1 | 13 | |
| Visual Question Answering | TallyQA (test) | Simple Accuracy86.2 | 12 | |
| Visual Question Answering | TallyQA simple | Accuracy86.3 | 10 | |
| Object Counting | TallyQA Simple | Accuracy86.3 | 9 | |
| Open-ended counting | TallyQA Complex 1.0 (test) | Accuracy (ACC)56.2 | 9 | |
| Open-ended counting | TallyQA Simple 1.0 (test) | Accuracy71.8 | 9 | |
| Visual Question Answering | TallyQA (ZOOM-Hard) | GPT Accuracy16.78 | 6 | |
| Visual Question Answering | TallyQA ZOOM-Medium | GPT Accuracy24.35 | 6 | |
| Visual Question Answering | TallyQA ZOOM-Easy | GPT Accuracy51.27 | 6 | |
| Counting | TallyQA (val) | Accuracy66 | 6 | |
| Object Counting | TallyQA | Score35 | 5 | |
| Counting | TallyQA Complex | Accuracy77.1 | 4 | |
| Visual Question Answering | TallyQA simple | Exact Match86 | 3 |
Showing 16 of 16 rows