Vision Question Answering on Q-Bench LLVisionQA 1.0 (dev)
74.5Overall Score
PhotoEye
Updated 8d ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2025.09 | 74.5 | 80.01 | 76.1 | 67.02 | 74.32 | 74.59 | |
2026.05 | 74.45 | - | - | - | - | - | |
2025.09 | 73.63 | 75.6 | 79.43 | 66.09 | 73.39 | 74.08 | |
2026.05 | 73.24 | - | - | - | - | - | |
2025.09 | 73.04 | 76.72 | 74.33 | 67.74 | 70.03 | 73.37 | |
2026.05 | 70.3 | - | - | - | - | - | |
2025.09 | 68.56 | 74.18 | 68.81 | 62.07 | 63.62 | 71.76 | |
2025.09 | 68.16 | 68.8 | 73.74 | 62.34 | 66.3 | 71.34 | |
2026.05 | 67.56 | - | - | - | - | - | |
2025.09 | 67.09 | 76.18 | 66.37 | 57.61 | 65.18 | 67.59 | |
2025.09 | 66.04 | 73.77 | 69.47 | 53.88 | 66.21 | 65.72 | |
2025.09 | 65.35 | 69.45 | 65.27 | 60.85 | 61.67 | 70.14 | |
2026.05 | 65.35 | - | - | - | - | - | |
2025.09 | 65.28 | 71.81 | 67.25 | 56.18 | 64.78 | 63.19 | |
2025.09 | 64.15 | 73.27 | 64.38 | 53.75 | 70.03 | 73.38 | |
2026.05 | 62.14 | - | - | - | - | - | |
2025.09 | 61.61 | 72.18 | 57.96 | 56.19 | 56.68 | 69.21 | |
2026.05 | 61.61 | - | - | - | - | - | |
2025.09 | 59.46 | 66.18 | 59.29 | 52.13 | 57.39 | 56.25 | |
2025.09 | 59.4 | 63.09 | 58.19 | 56.39 | 50.58 | 62.73 | |
2025.09 | 58.66 | 66.36 | 58.19 | 50.51 | 49.42 | 65.74 | |
2026.05 | 58.66 | - | - | - | - | - | |
2025.09 | 56.72 | 71.64 | 52.65 | 43.81 | 48.64 | 62.5 | |
2025.09 | 54.65 | 65.64 | 47.35 | 49.09 | 48.83 | 59.49 | |
2025.09 | 49.03 | 55.82 | 50.22 | 40.37 | 42.02 | 48.38 | |
2025.09 | 48.7 | 56.18 | 44.69 | 44.02 | 42.8 | 54.17 | |
2025.09 | 46.35 | 57.09 | 40.71 | 39.55 | 42.22 | 49.31 | |
2025.09 | 37.8 | 50 | 27.86 | 33.31 | 37.89 | 38.48 | |
2026.05 | 37.8 | - | - | - | - | - |