MME
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multimodal Evaluation | MME | Score2,565.72 | 557 | |
| Multimodal Understanding | MME | MME Score2,322 | 158 | |
| Multimodal Perception and Cognition | MME | Overall Score2,328.7 | 103 | |
| Comprehensive Multi-modal Evaluation | MME | Total Score2,220.5 | 73 | |
| Multimodal Model Evaluation | MME | Total Score2,005 | 63 | |
| Multi-modal Evaluation | MME (total) | MME Total Score2,433.61 | 61 | |
| Multimodal Perception | MME Perception | Perception Score1,689.7 | 61 | |
| Image Understanding | MME | Score2,312 | 39 | |
| Visual Understanding | MME | MME Score2,321 | 37 | |
| Multimodal Cognition | MME Cognition | Cognition Score525 | 34 | |
| Multimodal Understanding | MME Perception | MME-P Score1,567.1 | 33 | |
| Multi-modal Evaluation | MME (test) | Perception Score1,666 | 32 | |
| Multi-modal Perception Evaluation | MME Perception | Perception Score1,533 | 31 | |
| Visual Perception | MME Perception | MME^P1,555.2 | 27 | |
| Multimodal Understanding and Reasoning | MME | MME Score78.7 | 26 | |
| Multimodal Model Evaluation | MME | Score1,862 | 25 | |
| Multimodal Understanding | MME Cognition | Score1,293.8 | 25 | |
| Multimodal Understanding | MME Perception (test) | Perception Score1,696 | 24 | |
| Hallucination Evaluation | MME hallucination (test) | Existence Score180 | 24 | |
| Multimodal Perception | MME | MME Score2,184 | 24 | |
| Visual Understanding | MME perception and cognition v1.0 | MME Perception Score1,687 | 24 | |
| Multimodal Understanding | MME | Sum Score2,494.5 | 23 | |
| Multimodal Understanding | MME | Score2,347 | 22 | |
| Object Hallucination | MME | E Score195 | 22 | |
| Multi-modal Evaluation | MME | MME Score1,851 | 20 |
Showing 25 of 99 rows