Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
End-to-end cloud task execution on Cloud Benchmark 278-task (test)
Loading...
65.34
Pass@1
Gemini 3 Pro Preview
42.3976
48.3538
54.31
60.2662
Jun 8, 2026
Pass@1
Pass@3
Operational Cost
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass@1
Pass@3
Operational Cost
Gemini 3 Pro Preview
Deployment=API-only
2026.06
65.34
79.86
7
AliyunConsoleAgent-32B (SFT+GRPO)
Deployment=Private
2026.06
63.52
75.18
0.56
GPT-5.5
Deployment=API-only
2026.06
62.08
76.09
15.5
Kimi K2.6
Deployment=API-only
2026.06
60.79
73.38
2.7
Qwen3.6-Plus
Deployment=API-only
2026.06
57.69
72.66
0.97
AliyunConsoleAgent-32B (SFT)
Deployment=Private
2026.06
56.89
72.66
0.56
Qwen3-VL-32B-Instruct (Base)
Deployment=Private
2026.06
43.28
60.79
0.56
Feedback
Search any
task
Search any
task