MME
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multimodal Evaluation | MME | Score2,565.72 | 727 | |
| Multimodal Perception and Cognition | MME | Overall Score2,501.3 | 270 | |
| Multimodal Understanding | MME | MME Score2,322 | 207 | |
| Multimodal Evaluation | MME | MME Score2,375.9 | 173 | |
| Multi-modal Evaluation | MME | MME Score2,371.74 | 160 | |
| Multimodal Understanding | MME | Score2,393 | 125 | |
| Comprehensive Multi-modal Evaluation | MME | Total Score2,220.5 | 117 | |
| Multimodal Evaluation | MME | MME-P Score1,864 | 114 | |
| Multimodal Model Evaluation | MME | Score2,076 | 102 | |
| Multimodal Perception | MME Perception | Perception Score1,748.4 | 99 | |
| Multimodal Model Evaluation | MME | MME Score2,489.7 | 77 | |
| Multimodal Perception Assessment | MME Perception | MME-P1,702.17 | 77 | |
| Multi-modal Evaluation | MME (total) | MME Total Score2,433.61 | 76 | |
| Multimodal Model Evaluation | MME | Total Score2,005 | 71 | |
| Multimodal Evaluation | MME | Total Score2,631.7 | 67 | |
| Image Understanding | MME | Score2,500 | 66 | |
| Hallucination Evaluation | MME Hallucination | Existence Score195 | 61 | |
| Multimodal Understanding | MME Perception | MME-P Score1,692.5 | 59 | |
| Visual Understanding | MME | MME Score2,321 | 54 | |
| Visual Perception | MME Perception | MME^P1,742 | 50 | |
| Multimodal Understanding | MME Cognition | Score1,293.8 | 45 | |
| Multimodal Evaluation | MME Chinese | Overall Score60.37 | 43 | |
| Multimodal Evaluation | MME English | Score60.21 | 43 | |
| Multimodal Perception | MME | Perception Score2,242.7 | 43 | |
| Multimodal Perception and Cognition | MME (test) | Overall Score2,396 | 39 |
Showing 25 of 209 rows
...