MME
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multimodal Evaluation | MME | Score2,565.72 | 658 | |
| Multimodal Understanding | MME | MME Score2,322 | 207 | |
| Multimodal Perception and Cognition | MME | Overall Score2,403.8 | 182 | |
| Comprehensive Multi-modal Evaluation | MME | Total Score2,220.5 | 113 | |
| Multimodal Model Evaluation | MME | Score2,076 | 98 | |
| Multi-modal Evaluation | MME | MME Score1,862 | 89 | |
| Multimodal Understanding | MME | Score2,393 | 83 | |
| Multimodal Perception | MME Perception | Perception Score1,748.4 | 79 | |
| Multi-modal Evaluation | MME (total) | MME Total Score2,433.61 | 76 | |
| Multimodal Evaluation | MME | MME-P Score1,864 | 73 | |
| Multimodal Evaluation | MME | MME Score2,375.9 | 73 | |
| Multimodal Model Evaluation | MME | Total Score2,005 | 71 | |
| Multimodal Perception Assessment | MME Perception | MME-P1,696 | 54 | |
| Visual Understanding | MME | MME Score2,321 | 54 | |
| Visual Perception | MME Perception | MME^P1,742 | 50 | |
| Multimodal Understanding | MME Perception | MME-P Score1,692.5 | 46 | |
| Multimodal Evaluation | MME Chinese | Overall Score60.37 | 43 | |
| Multimodal Evaluation | MME English | Score60.21 | 43 | |
| Multimodal Perception | MME | Perception Score2,242.7 | 43 | |
| Multimodal Perception and Cognition | MME (test) | Overall Score2,396 | 39 | |
| Multimodal Understanding | MME | Sum Score2,494.5 | 39 | |
| Image Understanding | MME | Score2,312 | 39 | |
| Hallucination Evaluation | MME Hallucination | Existence Score195 | 39 | |
| Multimodal Cognition | MME Cognition | Cognition Score525 | 34 | |
| Multi-modal Evaluation | MME (test) | Perception Score1,666 | 32 |
Showing 25 of 154 rows