Abstract Visual Reasoning on I-RAVEN v1 (test)
93.2Avg Accuracy
algebraic machine reasoning
Updated 4d ago
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
2023.03 | 93.2 | 99.5 | 89.6 | 89.7 | 99.6 | 74.7 | 99.7 | 99.5 | |
2023.03 | 77 | 90.5 | 85.4 | 45.6 | 63.5 | 60.7 | 96.3 | 97.4 | |
2023.03 | 60.8 | 78.2 | 50.1 | 42.4 | 68.2 | 46.3 | 70.1 | 70.3 | |
2023.03 | 49.4 | 57.8 | 34.1 | 35.5 | 57 | 42.9 | 58.5 | 60 | |
2023.03 | 48.2 | 60 | 31.2 | 30 | 62.4 | 39 | 58.9 | 57.2 | |
2023.03 | 46.1 | 54.4 | 36.8 | 31.9 | 52.2 | 42.8 | 51.9 | 52.5 | |
2023.03 | 41.4 | 56.4 | 31.7 | 29.7 | 52.1 | 31.7 | 44.2 | 44.2 | |
2023.03 | 40.4 | 46.5 | 28.8 | 27.3 | 46 | 34.2 | 50.1 | 49.8 | |
2023.03 | 40.3 | 44.7 | 29.3 | 27.9 | 46.2 | 35.8 | 51.2 | 47.4 | |
2023.03 | 23.8 | 29.4 | 26.8 | 23.5 | 22.5 | 21.5 | 21.9 | 21.4 | |
2023.03 | 18.9 | 26.2 | 16.7 | 15.1 | 21.9 | 21.1 | 14.6 | 16.5 |