Smartphone Tasks
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Attack Success Rate Evaluation | 40 diverse smartphone tasks Total | Target Attack Success Rate (Tasr)95.8 | 16 | |
| Attack Success Rate Evaluation | 40 diverse smartphone tasks Persuade subcategory | Target ASR100 | 16 | |
| Attack Success Rate Evaluation | 40 diverse smartphone tasks Generate subcategory | Target ASR75 | 16 | |
| Attack Success Rate Evaluation | 40 diverse smartphone tasks Execute | TASR100 | 16 |
Showing 4 of 4 rows