InfoVQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Information Visual Question Answering | InfoVQA (test) | ANLS84.5 | 92 | |
| Visual Question Answering | InfoVQA | Accuracy87.1 | 69 | |
| Infographic Question Answering | InfoVQA | ANLS71.1 | 54 | |
| Visual Question Answering | InfoVQA (val) | Accuracy83.13 | 41 | |
| Infographic Visual Question Answering | InfoVQA | Accuracy84.1 | 40 | |
| Document Visual Question Answering | InfoVQA | ANLS88 | 32 | |
| Infographic Visual Question Answering | InfoVQA (test) | Accuracy81 | 31 | |
| Visual Question Answering | InfoVQA | ANLS Score78.98 | 19 | |
| Information Visual Question Answering | InfoVQA | Accuracy81.7 | 18 | |
| Document Understanding | InfoVQA (test) | Accuracy84.5 | 18 | |
| Infographic Question Answering | InfoVQA (val) | Accuracy70.5 | 17 | |
| Visual Question Answering | InfoVQA (test) | Accuracy88.9 | 13 | |
| Visual Question Answering | InfoVQA+ (val) | ANLS45.2 | 10 | |
| OCR VQA | InfoVQA (val) | Accuracy76.2 | 8 | |
| End-to-end Question Answering | InfoVQA (test) | EM60.91 | 7 | |
| Document Question Answering | InfoVQA (val) | Score76.12 | 7 | |
| OCR Visual Question Answering | InfoVQA 2022 (val) | Score67.2 | 7 | |
| OCR-related Understanding Tasks | InfoVQA (test) | Accuracy87.3 | 7 | |
| Text-oriented Visual Question Answering | InfoVQA | ANLS43.5 | 7 | |
| Retrieval | InfoVQA | R@393.17 | 6 | |
| Document/Chart Understanding | InfoVQA | Score77.1 | 3 | |
| Infographic Understanding | InfoVQA (test) | Accuracy74.9 | 3 | |
| Document Visual Question Answering | InfoVQA zero-shot | Zero-shot Accuracy64.48 | 2 |
Showing 23 of 23 rows