Multimodal Visual Document Retrieval on MMEB Visual Document portion v2
89.44ViDoRe V1 Score
gme-Qwen2-VL-7B-Instruct
Updated 16d ago
Evaluation Results
| Method | Links | |||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.03 | 89.44 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 55.61 | 84.99 | 44.4 | 75.18 | |
2025.11 | 89.4 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 55.6 | 85 | 44.4 | 75.2 | |
2026.03 | 89.35 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 61.41 | 89.28 | 44 | 77.12 | |
2026.03 | 88.14 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 58.64 | 89.06 | 42.84 | 75.91 | |
2026.03 | 86.15 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 53.96 | 82.52 | 43.12 | 72.71 | |
2025.11 | 86.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 54 | 82.5 | 43.1 | 72.7 | |
2026.04 | 86.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 54 | 82.5 | 43.1 | 72.7 | |
2026.03 | 85.53 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 56.57 | 84.74 | 43.14 | 73.44 | |
2025.11 | 83.6 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 52 | 81.1 | 43.1 | 71 | |
2026.03 | 83.6 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 51.98 | 81.13 | 43.12 | 70.97 | |
2026.03 | 80.05 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 59.59 | 79.32 | 43.34 | 70.34 | |
2025.11 | 79.7 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 55.8 | 86 | 40.7 | 70.8 | |
2025.11 | 76.8 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 51.5 | 82.6 | 41.5 | 68.2 | |
2026.03 | 76.39 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 53.18 | 77.64 | 41.17 | 66.96 | |
2025.11 | 75.7 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 50.5 | 83.7 | 37.6 | 67.1 | |
2026.03 | 75.52 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 44.86 | 79.38 | 39.43 | 65.36 | |
2025.11 | 75.5 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 44.9 | 79.4 | 39.4 | 65.4 | |
2026.04 | 75.5 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 44.9 | 79.4 | 39.4 | 65.4 | |
2025.11 | 72.4 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 46.2 | 79.2 | 37.2 | 63.9 | |
2026.04 | 72.4 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 46.2 | 79.2 | 37.2 | 63.9 | |
2026.04 | 72.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 49.8 | 78.1 | 57.4 | 67.5 | |
2025.11 | 70.7 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 49.6 | 79.5 | 38.1 | 63.9 | |
2025.11 | 67.6 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 43.3 | 47.1 | 33.8 | 52.8 | |
2026.04 | 67.6 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 43.3 | 47.1 | 33.8 | 52.8 | |
2025.11 | 67.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 35.2 | 82.6 | 34.9 | 60.3 | |
2025.11 | 56.9 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 9.4 | 59.1 | 38.1 | 46.4 | |
2025.11 | 56.3 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 33.3 | 58.2 | 40.1 | 50.2 | |
2025.11 | 49.8 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 13.5 | 51.8 | 33.5 | 41.6 | |
2026.04 | 49.8 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 13.5 | 51.8 | 33.5 | 41.6 | |
2025.11 | 22 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 11.5 | 37.4 | 21 | 23.9 | |
2026.04 | 22 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 11.5 | 37.4 | 21 | 23.9 | |
2026.02 | - | 81.7 | 56.6 | 84.9 | 86.9 | 70.9 | 75.1 | 95.7 | 94.7 | 93.6 | 95.9 | 51.3 | 54.7 | 49 | 52.9 | 80.9 | 72.3 | 82 | 85.1 | 83.5 | 79.3 | 38.1 | 87.5 | 27.1 | 80.4 | - | - | - | - | |
2026.02 | - | 86.9 | 57.5 | 91.6 | 94.6 | 74.1 | 96.8 | 99.6 | 95.3 | 98.8 | 99.3 | 63.4 | 49.5 | 54.2 | 55.4 | 87.4 | 86.1 | 89.7 | 92.6 | 88.6 | 76.5 | 32.6 | 90.3 | 36.9 | 85.2 | - | - | - | - | |
2026.02 | - | 60.2 | 34.7 | 70.4 | 78.2 | 27.6 | 38.6 | 67.7 | 60.4 | 61.8 | 69.9 | 6.8 | 5.1 | 13.9 | 11.9 | 52.6 | 57.7 | 60.6 | 54.7 | 66 | 62.7 | 16.3 | 69.4 | 0.4 | 28.8 | - | - | - | - | |
2026.02 | - | 80.6 | 44.9 | 83.7 | 89.2 | 43.8 | 60.8 | 88.5 | 86.5 | 85 | 92.2 | 45.6 | 44.3 | 43 | 46.6 | 76.9 | 83.7 | 88.1 | 84.1 | 82.3 | 75.9 | 29.1 | 79 | 15.8 | 63 | - | - | - | - | |
2026.02 | - | 73.3 | 38.3 | 80.6 | 80.7 | 37.8 | 52 | 86 | 84.8 | 85 | 88.4 | 50.7 | 50.9 | 54.3 | 42.3 | 74 | 82.7 | 75.1 | 87.6 | 87.9 | 69.4 | 22.5 | 73.8 | 13.3 | 42.6 | - | - | - | - | |
2026.02 | - | 73.9 | 37.9 | 76.2 | 86.1 | 40.6 | 66.8 | 85.9 | 83.3 | 82.6 | 90.8 | 50.2 | 46.2 | 45.7 | 42.7 | 74.3 | 86 | 75.6 | 87.1 | 84.4 | 68 | 21.2 | 75.9 | 11.9 | 39.7 | - | - | - | - | |
2026.02 | - | 73.6 | 41.1 | 80.8 | 90.2 | 46.7 | 65 | 89.5 | 85.7 | 89.8 | 94.3 | 50.4 | 50.7 | 57.8 | 43.2 | 80.5 | 85 | 83.4 | 91.5 | 89.2 | 72.7 | 21.3 | 75.3 | 12.3 | 41.3 | - | - | - | - | |
2026.02 | - | 86.1 | 45.7 | 86.8 | 94.5 | 54.6 | 70.7 | 94 | 86.7 | 89 | 91.1 | 56.9 | 51 | 53 | 46.9 | 84.9 | 88.3 | 79.1 | 92.3 | 90 | 73 | 82 | 82.6 | 47.7 | 50.3 | - | - | - | - | |
2026.02 | - | 88.7 | 47.5 | 86.9 | 94.7 | 54.8 | 69 | 91.6 | 88.1 | 90.7 | 90.4 | 59.8 | 50.1 | 53.9 | 49.7 | 86.9 | 88.5 | 79.3 | 92.6 | 89.6 | 72.4 | 84.4 | 82.4 | 51 | 50.7 | - | - | - | - |