InfoSeek
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | InfoSeek (test) | Accuracy57.9 | 81 | |
| Visual Question Answering | InfoSeek | Accuracy69 | 77 | |
| Visual Question Answering | InfoSeek (Full) | Accuracy43 | 61 | |
| Knowledge-Intensive Visual Question Answering | InfoSeek (val) | Accuracy (All)44.1 | 50 | |
| Visual Question Answering | InfoSeek | Unseen-Q Score47.8 | 49 | |
| Visual Question Answering | InfoSeek (val) | Overall Accuracy47.2 | 45 | |
| Uncertainty Quantification | InfoSeek (val) | Accuracy14.7 | 42 | |
| Knowledge-based Visual Question Answering | INFOSEEK Unseen Question | Accuracy46.5 | 42 | |
| Visual Information Seeking | InfoSeek | Pass@174.8 | 24 | |
| Multi-hop information-seeking | InfoSeek-Eval ID | Success Rate (SR)82 | 24 | |
| Visual Question Answering | INFOSEEK Unseen-E | Accuracy42.1 | 23 | |
| Visual Question Answering | InfoSeek | F1 Recall43.6 | 22 | |
| (Image, Text)-to-Text Retrieval | InfoSeek | Recall@570.3 | 20 | |
| Knowledge-based Visual Question Answering | INFOSEEK (Unseen Entity) | Accuracy51 | 19 | |
| Knowledge-Based Visual Question Answering | INFOSEEK | FR (All)42.5 | 18 | |
| Knowledge-based VQA | InfoSeek | Unseen-Q Performance42.49 | 18 | |
| Information Seeking Question Answering | InfoSeek | Accuracy73.9 | 17 | |
| Knowledge-Based Visual Question Answering | InfoSeek All | Accuracy49.9 | 16 | |
| Retrieval | InfoSeek | Recall@159.6 | 12 | |
| Re-ranking | InfoSeek | R@166.5 | 11 | |
| Retrieval | InfoSeek standard (val) | Recall@167 | 10 | |
| Entity Retrieval | InfoSeek (val) | R@164 | 9 | |
| Visual Question Answering | Infoseek M2KR setup (test) | VQA Accuracy42.8 | 8 | |
| Visual Question Answering | InfoSeek | Accuracy34.6 | 8 | |
| (Image, Text)-to-Multimodal Retrieval | InfoSeek | Recall@548.9 | 8 |
Showing 25 of 41 rows