Natural Language Camera Agent on SCOPE
56.5Comparative Relational
Qwen3-30B-A3B (Moondream3)
Updated 1mo ago
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
2026.06 | 56.5 | 76.8 | 37.1 | 66 | 98.2 | 79.6 | 77.8 | 98.6 | 73.8 | |
| 50 | 72.6 | 50.6 | 56.6 | 89.5 | 79.6 | 59.3 | 98.6 | 69.6 | ||
| 50 | 65.3 | 55.1 | 50.9 | 93 | 72.2 | 40.7 | 98.6 | 65.7 | ||
| 48.4 | 74.7 | 38.2 | 52.8 | 86 | 75.9 | 77.8 | 98.6 | 69.1 | ||
| 46.8 | 76.8 | 48.3 | 58.5 | 96.5 | 83.3 | 55.6 | 98.6 | 70.6 | ||
2026.06 | 45.2 | 68.4 | 39.3 | 52.8 | 89.5 | 72.2 | 83.3 | 100 | 68.8 | |
| 45.2 | 72.6 | 34.8 | 47.2 | 98.2 | 74.1 | 83.3 | 98.6 | 69.3 | ||
2026.06 | 43.5 | 70.5 | 44.9 | 52.8 | 93 | 81.5 | 53.7 | 98.6 | 67.3 | |
2026.06 | 41.9 | 70.5 | 46.1 | 64.2 | 96.5 | 72.2 | 53.7 | 98.6 | 68 | |
| 41.9 | 64.2 | 49.4 | 58.5 | 98.2 | 72.2 | 51.9 | 98.6 | 66.9 | ||
2026.06 | 37.1 | 60 | 59.6 | 64.2 | 87.7 | 68.5 | 51.9 | 98.6 | 65.9 | |
| 36.5 | 65.3 | 52.8 | 58.5 | 98.2 | 75.9 | 48.1 | 98.6 | 66.8 | ||
| 33.9 | 52.6 | 52.8 | 66 | 93 | 72.2 | 75.9 | 100 | 68.3 | ||
2026.06 | 32.3 | 62.1 | 47.2 | 50.9 | 91.2 | 66.7 | 48.1 | 100 | 62.3 | |
2026.06 | 32.3 | 68.4 | 33.7 | 47.2 | 87.7 | 55.6 | 66.7 | 100 | 61.4 | |
2026.06 | 30.6 | 73.7 | 34.8 | 58.5 | 87.7 | 59.3 | 57.4 | 98.6 | 62.6 | |
2026.06 | 27.4 | 68.4 | 38.2 | 52.8 | 89.5 | 64.8 | 38.9 | 97.2 | 59.7 | |
2026.06 | 27.4 | 69.5 | 40.4 | 56.6 | 89.5 | 61.1 | 40.7 | 97.2 | 60.3 | |
| 27.4 | 62.1 | 48.3 | 52.8 | 89.5 | 66.7 | 46.3 | 97.2 | 61.3 |