| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| WebShop | W2SG with MCTS | Success Rate99 | 57 | 18d ago | |
| AlfWorld | ResRL | Success Rate86.7 | 40 | 18d ago | |
| AppWorld Normal (test) | ACCORD | TGC92.3 | 29 | 1mo ago | |
| PinchBench (PB) | LLM-guided spec search | Accuracy100 | 21 | 2mo ago | |
| AppWorld Challenge (test) | ACCORD | Task Goal Completion (TGC)84.2 | 21 | 1mo ago | |
| Sudoku | Success Rate (SR)99 | 17 | 4mo ago | ||
| FrozenLake | Success Rate100 | 17 | 4mo ago | ||
| BlocksWorld | Success Rate100 | 17 | 4mo ago | ||
| Agent | Llama-3.2-1B-Instruct | Accuracy100 | 16 | 2mo ago | |
| ToolBench | PAIR | Success Rate44.98 | 16 | 2mo ago | |
| GTA | PAIR | Success Rate24.89 | 16 | 2mo ago | |
| SciWorld | PivoARL | Success Rate @198.4 | 13 | 18d ago | |
| Minesweeper | SKillRL | Suc@150.7 | 13 | 18d ago | |
| ScienceWorld | E3-TIR | Success Rate67.5 | 11 | 3mo ago | |
| AppWorld Average | ReAct + ACE | Average Score59.5 | 7 | 3mo ago | |
| AlfWorld | Ceiling Model | Average Reward59 | 7 | 4mo ago |
