Multimodal Question Answering on ScienceQA (test)
92.53Accuracy
LLaVa + GPT-4 (judge)
Updated 4d ago
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
2023.07 | 92.53 | - | 91.56 | 96.74 | 91.09 | 90.62 | 88.99 | 93.52 | 92.73 | 92.16 | |
2023.07 | 91.68 | - | 95.91 | 82 | 90.82 | 95.26 | 88.8 | 92.89 | 92.44 | 90.31 | |
2023.12 | 91.2 | 88.6 | - | - | - | - | - | - | - | - | |
2023.07 | 90.92 | - | 90.36 | 95.95 | 88 | 89.49 | 88 | 90.66 | 90.93 | 90.9 | |
2023.07 | 90.03 | - | 89.3 | 95.61 | 87 | 93.08 | 86.67 | 91.75 | 84.37 | 91.3 | |
2023.12 | 89.8 | 85.8 | - | - | - | - | - | - | - | - | |
2023.12 | 89.2 | 84.5 | - | - | - | - | - | - | - | - | |
2023.07 | 88.4 | - | 90.23 | 84.97 | 87.48 | 89.6 | 87.5 | 88.1 | 91.59 | 82.42 | |
2023.07 | 86.54 | - | 89.83 | 74.13 | 89.82 | 88.27 | 77.64 | 92.13 | 88.03 | 83.72 | |
2023.07 | 86.11 | - | 84.5 | 94.15 | 82.91 | 88.35 | 83.64 | 88.74 | 85.05 | 85.6 | |
2023.07 | 85.61 | - | 84.36 | 92.23 | 82.81 | 89.56 | 81.26 | 88.29 | 81.28 | 86.03 | |
2023.07 | 85.19 | - | 84.37 | 88.3 | 84.36 | 83.72 | 80.32 | 86.9 | 85.83 | 84.05 | |
2023.07 | 84.91 | - | 87.52 | 77.17 | 85.82 | 87.88 | 82.9 | 86.83 | 84.65 | 85.37 | |
2023.07 | 83.99 | - | 85.48 | 72.44 | 90.27 | 82.65 | 71.49 | 92.89 | 86.66 | 79.04 | |
2023.07 | 79.93 | - | 81.62 | 70.64 | 84 | 79.77 | 70.8 | 86.62 | 81.86 | 76.53 | |
2026.02 | 79.84 | - | - | - | - | - | - | - | - | - | |
2026.02 | 79.84 | - | - | - | - | - | - | - | - | - | |
2026.02 | 79.84 | - | - | - | - | - | - | - | - | - | |
2026.02 | 79.64 | - | - | - | - | - | - | - | - | - | |
2026.02 | 79.64 | - | - | - | - | - | - | - | - | - | |
2026.02 | 79.24 | - | - | - | - | - | - | - | - | - | |
2026.02 | 79.24 | - | - | - | - | - | - | - | - | - | |
2023.07 | 78.31 | - | 78.82 | 70.98 | 83.18 | 77.37 | 67.92 | 86.13 | 80.72 | 74.03 | |
2026.02 | 78.24 | - | - | - | - | - | - | - | - | - | |
2026.02 | 78.24 | - | - | - | - | - | - | - | - | - | |
2026.02 | 78.04 | - | - | - | - | - | - | - | - | - | |
2026.02 | 78.04 | - | - | - | - | - | - | - | - | - | |
2026.02 | 78.04 | - | - | - | - | - | - | - | - | - | |
2026.02 | 77.45 | - | - | - | - | - | - | - | - | - | |
2026.02 | 76.45 | - | - | - | - | - | - | - | - | - | |
2026.02 | 76.25 | - | - | - | - | - | - | - | - | - | |
2026.02 | 76.25 | - | - | - | - | - | - | - | - | - | |
2026.02 | 75.25 | - | - | - | - | - | - | - | - | - | |
2023.07 | 75.17 | - | 75.44 | 70.87 | 78.09 | 74.68 | 67.43 | 79.93 | 78.23 | 69.68 | |
2026.02 | 74.25 | - | - | - | - | - | - | - | - | - | |
2026.02 | 74.25 | - | - | - | - | - | - | - | - | - | |
2026.02 | 74.25 | - | - | - | - | - | - | - | - | - | |
2023.07 | 74.11 | - | 71 | 76.04 | 78.91 | 66.42 | 66.53 | 81.81 | 77.06 | 68.82 | |
2023.07 | 74.04 | - | 75.04 | 66.59 | 78 | 74.24 | 65.74 | 79.58 | 76.36 | 69.87 | |
2026.02 | 73.85 | - | - | - | - | - | - | - | - | - | |
2026.02 | 73.65 | - | - | - | - | - | - | - | - | - | |
2026.02 | 72.85 | - | - | - | - | - | - | - | - | - | |
2026.02 | 72.85 | - | - | - | - | - | - | - | - | - | |
2026.02 | 72.85 | - | - | - | - | - | - | - | - | - | |
2026.02 | 72.26 | - | - | - | - | - | - | - | - | - | |
2026.02 | 72.26 | - | - | - | - | - | - | - | - | - | |
2026.02 | 71.06 | - | - | - | - | - | - | - | - | - | |
2026.02 | 71.06 | - | - | - | - | - | - | - | - | - | |
2026.02 | 70.46 | - | - | - | - | - | - | - | - | - | |
2026.02 | 70.46 | - | - | - | - | - | - | - | - | - | |
2026.02 | 70.46 | - | - | - | - | - | - | - | - | - | |
2026.02 | 70.26 | - | - | - | - | - | - | - | - | - | |
2023.07 | 70.12 | - | 68.16 | 69.18 | 74.91 | 63.78 | 61.38 | 77.84 | 72.98 | 65 | |
2026.02 | 70.06 | - | - | - | - | - | - | - | - | - | |
2026.02 | 69.86 | - | - | - | - | - | - | - | - | - | |
2026.02 | 69.86 | - | - | - | - | - | - | - | - | - | |
2026.02 | 69.66 | - | - | - | - | - | - | - | - | - | |
2026.02 | 67.81 | - | - | - | - | - | - | - | - | - | |
2026.02 | 67.27 | - | - | - | - | - | - | - | - | - | |
2026.02 | 66.27 | - | - | - | - | - | - | - | - | - | |
2026.02 | 63.52 | - | - | - | - | - | - | - | - | - | |
2026.02 | 62.28 | - | - | - | - | - | - | - | - | - | |
2026.02 | 61.88 | - | - | - | - | - | - | - | - | - | |
2026.02 | 59.28 | - | - | - | - | - | - | - | - | - | |
2023.07 | 39.83 | - | 40.28 | 46.13 | 29.25 | 47.45 | 40.08 | 33.66 | 39.35 | 40.67 |