MMBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multimodal Understanding | MMBench | Accuracy90.6 | 887 | |
| Multimodal Understanding | MMBench CN | Accuracy88.5 | 302 | |
| Multimodal Model Evaluation | MMBench | Accuracy87.8 | 265 | |
| Multimodal Reasoning | MMBench | Accuracy90.63 | 180 | |
| Visual Question Answering | MMBench (MMB) | Accuracy92.1 | 169 | |
| Multimodal Benchmarking | MMBench | Accuracy87.27 | 168 | |
| Multimodal Understanding | MMBench (MMB) | Accuracy86.3 | 166 | |
| Multimodal Evaluation | MMBench CN | Accuracy82.8 | 163 | |
| Multimodal Model Evaluation | MMBench Chinese | Accuracy82.6 | 154 | |
| Multimodal Benchmarking | MMBench-CN | Score92.39 | 151 | |
| Multimodal Evaluation | MMBench | MMB^CN Score86 | 146 | |
| Vision Understanding | MMBench | Accuracy85 | 141 | |
| Multimodal Understanding | MMBench | Accuracy90.1 | 137 | |
| Multimodal Reasoning | MMBench EN V1.1 | Accuracy80.68 | 125 | |
| Multimodal Benchmarking | MMBench English | Accuracy70.4 | 125 | |
| Multimodal Reasoning | MMBench CN | Accuracy82 | 119 | |
| Multi-modal Understanding | MMBench EN | Accuracy93.53 | 113 | |
| Multimodal Benchmark | MMBench (MMB) | Accuracy81.8 | 111 | |
| Visual Question Answering | MMBench-CN | Accuracy93.13 | 99 | |
| Multimodal Understanding | MMBench Chinese | MMB Benchmark (CN)89.5 | 96 | |
| Vision-Language Understanding | MMBench | Accuracy88.7 | 88 | |
| GUI Grounding | MMBench-GUI L2 (test) | Average Error2.9 | 87 | |
| Multi-modal Question Answering | MMBench | Accuracy86.4 | 84 | |
| Multimodal Understanding | MMBench English | Accuracy88.79 | 81 | |
| Multi-modal Understanding | MMBench | Mean Accuracy86.3 | 79 |
Showing 25 of 218 rows
...