MuirBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multi-image Reasoning | MuirBench | Accuracy77.2 | 61 | |
| Multi-image Understanding | MuirBench | Score68 | 26 | |
| Multi-image reasoning | Muirbench (test) | Accuracy68 | 24 | |
| Multi-Image Understanding | MuirBench (test) | Accuracy68 | 21 | |
| Visual Question Answering | MuirBench | Accuracy78.6 | 19 | |
| Multi-modal Reasoning | MUIRBENCH | Difference Reasoning Accuracy92.94 | 19 | |
| Multi-Image Understanding | MuirBench 142 (test) | Score86.1 | 19 | |
| Multi-image Understanding | MuirBench Multi-image Understanding | Accuracy62.3 | 17 | |
| Multi-modal Understanding | MuirBench | Score59.6 | 16 | |
| Multi-image hallucination evaluation | MUIRBench | Accuracy62 | 12 | |
| Vision-Centric Reasoning | MuirBench | Accuracy68 | 11 | |
| Multimodal Reasoning | MuirBench | Accuracy57.14 | 11 | |
| Vision-Centric Understanding | MuirBench | Accuracy68 | 10 | |
| Procedural Temporal Understanding | MuirBench (test) | Overall Score65.04 | 7 | |
| General Visual Question Answering | MuirBench | Score70.7 | 5 | |
| Multi-image Visual Question Answering | MUIRBench | Accuracy76.4 | 4 | |
| Comprehensive Multi-image | MuirBench | Accuracy62.3 | 4 | |
| Multi-image Multi-modal Understanding | MuirBench | Accuracy41.8 | 2 |
Showing 18 of 18 rows