Task goal completion on AppWorld (test challenge)
32Goal Completion Score
RLOO
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.03 | 32 | 40 | 0.01 | |
2026.03 | 32 | 36 | 0 | |
2026.03 | 30 | 33 | 0 | |
2026.03 | 28 | 29 | 0.06 | |
2026.03 | 26 | 28 | -0.01 | |
2026.03 | 25 | 27 | -0.01 | |
2026.03 | 21 | 23 | -0.09 | |
2026.03 | 19 | 22 | -0.08 | |
2026.03 | 0.61 | 0.71 | -0.18 | |
2026.03 | 0.58 | 0.62 | 0.52 | |
2026.03 | 0.54 | 0.63 | 0.03 | |
2026.03 | 0.52 | 0.55 | 1.52 | |
2026.03 | 0.51 | 0.51 | -0.07 | |
2026.03 | 0.49 | 0.51 | 0.14 | |
2026.03 | 0.46 | 0.49 | -0.29 | |
2026.03 | 0.45 | 0.47 | -0.31 |