Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Visual Question Answering on VQA 2.0
Loading...
54.5
Accuracy
OctoTools
46.908
48.879
50.85
52.821
Feb 16, 2025
Accuracy
Accuracy Delta (Zero-Shot)
Accuracy Delta (CoT)
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
Accuracy Delta (Zero-Shot)
Accuracy Delta (CoT)
OctoTools
Backbone=gpt-4o-2024-0...
2025.02
54.5
4.2
5.8
0-shot
Backbone=gpt-4o-2024-0...
2025.02
50.3
-
-
CoT
Backbone=gpt-4o-2024-0...
2025.02
48.7
-
-
OctoToolsbase
Backbone=gpt-4o-2024-0...
2025.02
47.2
-
-
Feedback
Search any
task
Search any
task