Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Counterfactual Reasoning on C-VQA
Loading...
80.6
Numerical Direct Accuracy
ViperGPT
22.568
37.634
52.7
67.766
Mar 28, 2023
Numerical Direct Accuracy
Numerical Direct Loss
Numerical Indirect Accuracy
Numerical Indirect Loss
Boolean Accuracy
Boolean Loss
Updated 3d ago
Evaluation Results
Method
Method
Links
Numerical Direct Accuracy
Numerical Direct Loss
Numerical Indirect Accuracy
Numerical Indirect Loss
Boolean Accuracy
Boolean Loss
ViperGPT
2023.03
80.6
19.4
31.6
68.4
21.6
72.4
LLaMA-Adapter
Model Size=7B
2023.03
30.1
5.8
34.3
5.6
45.8
14.5
LLaVA
Model Size=7B
2023.03
27
9.9
25
15.2
58.5
4.8
LLaVA
Model Size=13B
2023.03
24.8
11.9
20.8
21.2
56.3
4.7
Feedback
Search any
task
Search any
task