TallyQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | TallyQA | Accuracy94.09 | 29 | |
| Counting | TallyQA | Accuracy80.8 | 28 | |
| Open-ended counting | TallyQA (test) | Simple Accuracy86.2 | 14 | |
| Visual Question Answering | TallyQA complex | Accuracy77.1 | 13 | |
| Visual Question Answering | TallyQA (test) | Simple Accuracy86.2 | 12 | |
| Visual Question Answering | TallyQA simple | Accuracy86.3 | 10 | |
| Object Counting | TallyQA Simple | Accuracy86.3 | 9 | |
| Open-ended counting | TallyQA Complex 1.0 (test) | Accuracy (ACC)56.2 | 9 | |
| Open-ended counting | TallyQA Simple 1.0 (test) | Accuracy71.8 | 9 | |
| Counting | TallyQA (val) | Accuracy66 | 6 | |
| Counting | TallyQA Complex | Accuracy77.1 | 4 | |
| Visual Question Answering | TallyQA simple | Exact Match86 | 3 |
Showing 12 of 12 rows