Interactive Desktop Task Success on OSWorld
59.91Chrome Success Rate
Gemini 1.5 Pro + MMSkills
Updated 20d ago
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.05 | 59.91 | 50 | 53.19 | 53.19 | 60.86 | 24.11 | 70.83 | 66.67 | 70.59 | 65.22 | 50.11 | |
2026.05 | 59.91 | 69.23 | 23.4 | 32.01 | 47.82 | 19.35 | 41.67 | 73.33 | 41.18 | 56.52 | 39.17 | |
2026.05 | 57.69 | 40 | 40.43 | 36.14 | 17.38 | 22.38 | 62.5 | 53.33 | 58.82 | 43.48 | 39.66 | |
2026.05 | 57.69 | 42.31 | 40.43 | 48.92 | 60.86 | 23.4 | 79.17 | 73.33 | 41.18 | 69.57 | 46.59 | |
2026.05 | 55.37 | 42.31 | 53.19 | 40.34 | 56.52 | 30.98 | 75 | 66.67 | 52.94 | 60.87 | 47.97 | |
2026.05 | 53.47 | 34.62 | 57.45 | 40.43 | 47.82 | 31.97 | 54.17 | 40 | 35.29 | 56.52 | 44.08 | |
2026.05 | 53.24 | 53.85 | 31.91 | 31.98 | 52.17 | 20.24 | 20.83 | 46.67 | 35.29 | 65.22 | 36.61 | |
2026.05 | 51.02 | 23.08 | 38.3 | 34 | 56.52 | 19.16 | 54.17 | 60 | 58.82 | 52.17 | 40.27 | |
2026.05 | 51.02 | 53.85 | 31.91 | 31.83 | 43.47 | 22.26 | 66.67 | 40 | 23.53 | 65.22 | 38.51 | |
2026.05 | 51.02 | 34.62 | 34.04 | 35.32 | 30.43 | 14.86 | 54.17 | 66.67 | 32.6 | 52.17 | 34.98 | |
2026.05 | 44.35 | 34.62 | 38.3 | 40.34 | 56.52 | 22.38 | 70.83 | 66.67 | 41.18 | 56.52 | 40.76 | |
2026.05 | 42.22 | 50 | 10.64 | 21.31 | 34.78 | 14.86 | 33.33 | 60 | 35.29 | 47.83 | 28.57 | |
| 39.91 | 42.31 | 8.51 | 23.37 | 17.39 | 13.43 | 25 | 60 | 29.41 | 47.83 | 25.4 | ||
2026.05 | 37.78 | 50 | 38.3 | 29.73 | 52.17 | 21.51 | 54.17 | 66.67 | 52.39 | 47.83 | 36.65 | |
2026.05 | 37.78 | 19.23 | 21.28 | 29.7 | 26.08 | 18.7 | 54.17 | 53.33 | 11.76 | 47.83 | 28.71 | |
| 19.91 | 11.54 | 6.38 | 16.99 | 17.39 | 7.33 | 16.67 | 33.33 | 17.65 | 34.78 | 14.93 | ||
2026.05 | 15.56 | 38.46 | 17.02 | 25.53 | 43.48 | 9.48 | 25 | 26.67 | 17.65 | 34.78 | 21.34 | |
| 15.47 | 7.69 | 2.13 | 8.59 | 4.34 | 7.33 | 25 | 13.33 | 29.41 | 17.39 | 10.78 |