MME
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multimodal Evaluation | MME | Score2,565.72 | 902 | |
| Multimodal Perception and Cognition | MME | Overall Score2,515.82 | 344 | |
| Multi-modal Evaluation | MME | MME Score2,389.7 | 240 | |
| Multimodal Understanding | MME | MME Score2,322 | 207 | |
| Multimodal Evaluation | MME | MME Score2,375.9 | 179 | |
| Multimodal Understanding | MME | Score2,393 | 150 | |
| Multimodal Evaluation | MME | MME-P Score1,864 | 139 | |
| Comprehensive Multi-modal Evaluation | MME | Total Score2,306.5 | 130 | |
| Multimodal Model Evaluation | MME | Score2,307.6 | 123 | |
| Multimodal Perception | MME Perception | Perception Score1,748.4 | 99 | |
| Multimodal Model Evaluation | MME | MME Score2,489.7 | 80 | |
| Multimodal Perception Assessment | MME Perception | MME-P1,702.17 | 77 | |
| Multi-modal Evaluation | MME (total) | MME Total Score2,433.61 | 76 | |
| Multimodal Understanding | MME Perception | MME-P Score1,699.5 | 74 | |
| Multimodal Model Evaluation | MME | Total Score2,005 | 71 | |
| Multimodal Evaluation | MME | Total Score2,631.7 | 67 | |
| Image Understanding | MME | Score2,500 | 66 | |
| Hallucination Evaluation | MME Hallucination | Existence Score195 | 61 | |
| Visual Understanding | MME | MME Score2,321 | 54 | |
| Visual Perception | MME Perception | MME^P1,742 | 50 | |
| Multimodal Perception | MME | Perception Score2,242.7 | 45 | |
| Multimodal Understanding | MME Cognition | Score1,293.8 | 45 | |
| Multi-modal Evaluation | MME | MME Perception Score1,731 | 43 | |
| Multimodal Evaluation | MME Chinese | Overall Score60.37 | 43 | |
| Multimodal Evaluation | MME English | Score60.21 | 43 |
Showing 25 of 239 rows
...