Action Prediction on Mind2Web (Cross-Website)
57.2Element Accuracy
Magma-8B
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.02 | 57.2 | 76.9 | 45.4 | |
2024.01 | 42 | 65.2 | 38.9 | |
2024.11 | 42 | 65.2 | 38.9 | |
2024.11 | 41.6 | 83.5 | 35.1 | |
2024.11 | 41 | 84.8 | 36.5 | |
2024.11 | 41 | 83.6 | 34.2 | |
2025.02 | 41 | 84.8 | 36.5 | |
2025.02 | 39.2 | - | 31 | |
2025.02 | 38 | 67.8 | 32.4 | |
2024.11 | 36 | 79.2 | 27.6 | |
2024.01 | 35.8 | 51.1 | 30.1 | |
2024.11 | 35.8 | 51.1 | 30.1 | |
2025.02 | 35.8 | 51.1 | 30.1 | |
2024.02 | 32.7 | 72 | 32.5 | |
2024.02 | 32 | 71.5 | 31.5 | |
2024.02 | 30.7 | 67 | 30 | |
2025.02 | 27.3 | - | 23.4 | |
2025.12 | 24.2 | - | 18 | |
2024.11 | 21.9 | 81.9 | 16.8 | |
2025.02 | 21.5 | 67.7 | 19.6 | |
2024.01 | 21.4 | 80.6 | 16.4 | |
2024.11 | 21.4 | 80.6 | 16.4 | |
2025.02 | 21.4 | 80.6 | 16.4 | |
2025.12 | 20.9 | - | 13.6 | |
2025.02 | 20.3 | 81.7 | 17.3 | |
2024.01 | 19.3 | 48.8 | 16.2 | |
2024.11 | 18.4 | 42.4 | 13.4 | |
2025.12 | 16.5 | - | 11.9 | |
2024.01 | 13.9 | 44.7 | 11 | |
2025.02 | 13.9 | 80.7 | 12.2 | |
2024.01 | 13.2 | 83.5 | 9.2 | |
2024.11 | 13.2 | 83.5 | 9.2 | |
2025.02 | 13.2 | 83.5 | 9.2 | |
2025.12 | 12.1 | - | 8.2 | |
2025.12 | 11.8 | - | 8.7 | |
2025.12 | 10.2 | - | 6.6 | |
2025.12 | 9.2 | - | 5.9 | |
2025.02 | 8.2 | 78.2 | 6 | |
2025.02 | 4.8 | 81.3 | 4 | |
2025.12 | 2.7 | - | 1.2 | |
2025.02 | - | 13.9 | - |