E-VQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Lifelong Knowledge Editing | E-VQA Lifelong Sequential | Rel. Score96.67 | 72 | |
| Visual Question Answering | E-VQA (test) | Accuracy84.03 | 56 | |
| Knowledge Editing | E-VQA MMEdit 1.0 (test) | Reliability100 | 24 | |
| Knowledge-Intensive Visual Question Answering | E-VQA (test) | BEM (Single-Hop)42.2 | 15 | |
| Visual Question Answering | E-VQA | Accuracy53.7 | 15 | |
| Conflict Discrimination | E-VQA (test) | MCC93.4 | 12 | |
| Entity Retrieval | E-VQA (test) | Recall@10.428 | 7 | |
| Knowledge-based Visual Retrieval | E-VQA 1.0 (test) | MRR@50.4492 | 6 | |
| Retrieval | E-VQA (test) | PR@50.781 | 5 | |
| Multimodal Multi-hop Visual Question Answering | E-VQA Two hop | Accuracy23.3 | 4 | |
| Knowledge-based Visual Question Answering | E-VQA M2KR | BEM54.45 | 3 | |
| Knowledge-based Visual Question Answering | E-VQA (test) | Accuracy56.2 | 2 |
Showing 12 of 12 rows