Task goal completion on AppWorld (test challenge)
32Goal Completion Score
RLOO
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.03 | 32 | 40 | 0.01 | |
2026.03 | 32 | 36 | 0 | |
2026.03 | 30 | 33 | 0 | |
2026.03 | 28 | 29 | 0.06 | |
2026.03 | 26 | 28 | -0.01 | |
2026.03 | 25 | 27 | -0.01 | |
2026.03 | 21 | 23 | -0.09 | |
2026.03 | 19 | 22 | -0.08 | |
2026.06 | 0.854 | - | 4.3 | |
2026.06 | 0.811 | - | - | |
2026.06 | 0.753 | - | 5 | |
2026.06 | 0.703 | - | - | |
2026.06 | 0.693 | - | 22.3 | |
2026.06 | 0.676 | - | - | |
2026.06 | 0.664 | - | 13.9 | |
2026.06 | 0.64 | - | 13.6 | |
2026.06 | 0.631 | - | 16.1 | |
2026.03 | 0.61 | 0.71 | -0.18 | |
2026.03 | 0.58 | 0.62 | 0.52 | |
2026.06 | 0.576 | - | 7.2 | |
2026.06 | 0.549 | - | 5.5 | |
2026.03 | 0.54 | 0.63 | 0.03 | |
2026.06 | 0.525 | - | - | |
2026.03 | 0.52 | 0.55 | 1.52 | |
2026.03 | 0.51 | 0.51 | -0.07 | |
2026.06 | 0.504 | - | - | |
2026.06 | 0.499 | - | 2.6 | |
2026.06 | 0.494 | - | - | |
2026.03 | 0.49 | 0.51 | 0.14 | |
2026.06 | 0.47 | - | - | |
2026.03 | 0.46 | 0.49 | -0.29 | |
2026.03 | 0.45 | 0.47 | -0.31 | |
2026.06 | 0.41 | - | 10.8 | |
2026.06 | 0.389 | - | 8.7 | |
2026.06 | 0.302 | - | - |