| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| AndroidWorld | Human | Success Rate80 | 200 | 24d ago | |
| MemGUI-Bench (Overall) | MemGUI-Agent-235B | Precision@137.5 | 19 | 1mo ago | |
| MemGUI-Bench Hard | MemGUI-Agent-235B | P@134.2 | 19 | 1mo ago | |
| MemGUI-Bench Medium | M3A | Precision@135.7 | 19 | 1mo ago | |
| MemGUI-Bench Easy | Agent-S2 | P@141.7 | 19 | 1mo ago | |
| DroidTask | AppAgentX | Success Rate88.6 | 9 | 2mo ago | |
| Mind2Web (live) | SeeAct-V + GPT-4o + UGround | Completion Rate50.8 | 4 | 4mo ago | |
| OSWORLD noisy (Overall) | UI-TARS-1.5-7B + ENVS | Pass@8 Success Rate29 | 3 | 1mo ago | |
| OSWORLD noisy (Held-out) | UI-TARS-1.5-7B + ARPO | Pass@8 Success Rate5.1 | 3 | 1mo ago | |
| OSWORLD noisy (Trained (86)) | UI-TARS-1.5-7B + ENVS | Pass@8 Success Rate88.4 | 3 | 1mo ago | |
| OSWORLD clean (Overall) | UI-TARS-1.5-7B + ENVS | Pass@8 Success Rate30.3 | 3 | 1mo ago | |
| OSWORLD clean (held-out) | UI-TARS-1.5-7B + ENVS | Pass@8 Success Rate7.5 | 3 | 1mo ago | |
| OSWORLD clean (Trained (86)) | UI-TARS-1.5-7B + ENVS | pass@8 Success Rate87.2 | 3 | 1mo ago | |
| WebArena Reddit | ActionEngine | Success Rate0.95 | 2 | 4mo ago |
