Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Physical Task Execution on Virtual-Tool (test)
Loading...
33.3
Pass@1
Human
-1.332
7.659
16.65
25.641
Jul 7, 2026
Pass@1
Pass@3
Pass@5
Updated 17d ago
Evaluation Results
Method
Method
Links
Pass@1
Pass@3
Pass@5
Human
2026.07
33.3
66.1
77.8
+EG+VAORA
base model=Qwen3VL-8B-SFT
2026.07
16.7
22.2
33.3
Gemini-3.1-Flash
type=Closed-Source API
2026.07
11.1
27.8
27.8
Gemini-3.1-Pro
type=Closed-Source API
2026.07
11.1
27.8
38.9
Qwen3-VL-8B-Instruct
type=Open-Sourced Base...
2026.07
5.6
16.7
16.7
DQN-expert (phyre)
2026.07
0
5.6
5.6
Qwen3-VL-8B (SFT)
type=Open-Sourced Base...
2026.07
0
16.7
22.2
Feedback
Search any
task
Search any
task