Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Visual Question Answering on SimpleVQA
Loading...
63.4
Pass@1
Seed 1.5-VL
49.568
53.159
56.75
60.341
May 11, 2025
Pass@1
Updated 3d ago
Evaluation Results
Method
Method
Links
Pass@1
Seed 1.5-VL
thinking=true, decodin...
2025.05
63.4
Seed 1.5-VL
thinking=false, decodi...
2025.05
63.1
Gemini 1.5 Pro
thinking=true, decodin...
2025.05
62
OpenAI o1
thinking=true, decodin...
2025.05
58.8
GPT-4o
thinking=false, decodi...
2025.05
52.4
Qwen 2.5-VL 72B
thinking=false, decodi...
2025.05
52.4
Claude 3.7 Sonnet
thinking=true, decodin...
2025.05
50.1
Feedback
Search any
task
Search any
task