Agent Task Performance on Claw-Eval Isolated Mode v1 (test)
64.5Overall Success Rate
Vanilla
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.06 | 64.5 | 65.4 | 70.8 | 45.7 | 44.4 | 73.2 | 70.9 | 77.7 | 74 | 56.8 | 41 | 69.2 | 9.429 | 4.637 | 0.216 | 5.16 | |
2026.06 | 63.1 | 68.1 | 75.4 | 47 | 22.3 | 71.8 | 65 | 72 | 47.8 | 37 | 45.6 | 69.9 | 4.436 | 1.154 | 0.239 | 2.27 | |
2026.06 | 62 | 70 | 71 | 32.2 | 20.6 | 80 | 68.5 | 82.8 | 49.2 | 20 | 41 | 71.4 | 2.935 | 2.871 | 0.174 | 3.16 | |
2026.06 | 61.9 | 58.7 | 67.5 | 57.6 | 43.3 | 62.9 | 70.1 | 62.4 | 61 | 49.6 | 44 | 75.2 | 8.169 | 4.043 | 0.182 | 4.44 | |
2026.06 | 61.8 | 67.1 | 73.8 | 44.7 | 21.6 | 54.5 | 63.6 | 86.2 | 38.4 | 39.4 | 55 | 69.1 | 4.229 | 1.845 | 0.186 | 2.54 | |
2026.06 | 61.6 | 64.7 | 74.2 | 40.9 | 25.2 | 71.2 | 32 | 73.6 | 80.2 | 20 | 56.2 | 74.6 | 12.582 | 2.709 | 0.363 | 4.61 | |
2026.06 | 61.2 | 59 | 67.3 | 51.1 | 47.7 | 65.9 | 76.6 | 58.4 | 58.6 | 51.4 | 41.5 | 72.2 | 9.776 | 3.543 | 0.172 | 4.17 | |
2026.06 | 60.9 | 64.2 | 66.5 | 44.1 | 45.7 | 67.8 | 52.8 | 85.8 | 57.2 | 25.6 | 53.6 | 68.8 | 4.58 | 3.585 | 0.194 | 3.91 | |
2026.06 | 60.7 | 59.1 | 68.2 | 46.3 | 36.9 | 61.5 | 75.5 | 59.2 | 67.2 | 53.1 | 44 | 74.7 | 8.271 | 3.862 | 0.181 | 4.31 | |
2026.06 | 59.3 | 57.3 | 62.1 | 38.2 | 39.4 | 68.5 | 65 | 91.6 | 64.1 | 25.6 | 55 | 76.5 | 4.648 | 3.944 | 0.186 | 4.14 | |
2026.06 | 58 | 64.5 | 60.5 | 26.1 | 37.6 | 56.1 | 59.9 | 71 | 63.4 | 20 | 41 | 75.3 | 18.182 | 5.118 | 0.332 | 6.69 |