Multimodal In-Context Learning on VL-ICL benchmark
77.6Average Accuracy
MM1.5-30B
Updated 3d ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2024.09 | 77.6 | 46.5 | 66.5 | 100 | 65 | 80 | 44.5 | |
2024.09 | 65.8 | 42 | 81 | 56 | 92 | 74 | 50 | |
2024.09 | 59.6 | 32 | 58 | 92 | 63.3 | 65 | 47.5 | |
2024.09 | 56.3 | 33.5 | 59 | 88 | 48.3 | 66.7 | 42.5 | |
2024.09 | 56.3 | - | - | - | - | - | - | |
2024.09 | 56 | 33 | 56.5 | 89 | 56.7 | 56.7 | 44 | |
2024.09 | 56 | 25.5 | 52.8 | 98.5 | 68.3 | 60 | 31 | |
2024.09 | 56 | - | - | - | - | - | - | |
2024.09 | 52.8 | 33 | 69.5 | 97.5 | 40 | 45 | 32 | |
2024.09 | 52.1 | 25 | 63 | 98.5 | 51.7 | 38.3 | 36 | |
2024.09 | 51 | 39 | 52 | 84 | 60 | 36.7 | 34 | |
2024.09 | 51 | - | - | - | - | - | - | |
2024.09 | 37 | 27.5 | 50 | 79 | 18.3 | 13.3 | 34 | |
2024.09 | 35.6 | 31.5 | 50 | 52.5 | 21.7 | 28.3 | 29.5 | |
2024.09 | 34.3 | 25 | 49.3 | 73 | 16.7 | 8.3 | 33.5 | |
2024.09 | 31.9 | 26.8 | 56.4 | 58 | 18.9 | 8.9 | 22.3 | |
2024.09 | 30.9 | 20 | 50.1 | 49 | 39.4 | 11.1 | 16 | |
2024.09 | 28 | 27.7 | 50 | 53.8 | 7.8 | 6.1 | 22.8 | |
2024.09 | 26.9 | 14.8 | 50 | 28.2 | 21.7 | 10 | 36.5 | |
2024.09 | 20.9 | 18.8 | 50 | 51.2 | 2.8 | 2.8 | 0 | |
2024.09 | 19.5 | 17 | 50 | 1 | 26.7 | 8.3 | 14 | |
2024.09 | 19.5 | - | - | - | - | - | - | |
2024.09 | 18.5 | - | - | - | - | - | - | |
2024.09 | 17.9 | 8.2 | 50.4 | 28.5 | 12.2 | 7.2 | 0.8 | |
2024.09 | 12.7 | 17.8 | 50 | 0 | 3.3 | 5 | 0 |