Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Counterfactual Reasoning on C-VQA
Loading...
80.6
Numerical Direct Accuracy
ViperGPT
22.568
37.634
52.7
67.766
Mar 28, 2023
Numerical Direct Accuracy
Numerical Direct Loss
Numerical Indirect Accuracy
Numerical Indirect Loss
Boolean Accuracy
Boolean Loss
Updated 1mo ago
Evaluation Results
Method
Method
Links
Numerical Direct Accuracy
Numerical Direct Loss
Numerical Indirect Accuracy
Numerical Indirect Loss
Boolean Accuracy
Boolean Loss
ViperGPT
2023.03
80.6
19.4
31.6
68.4
21.6
72.4
LLaMA-Adapter
Model Size=7B
2023.03
30.1
5.8
34.3
5.6
45.8
14.5
LLaVA
Model Size=7B
2023.03
27
9.9
25
15.2
58.5
4.8
LLaVA
Model Size=13B
2023.03
24.8
11.9
20.8
21.2
56.3
4.7
Feedback
Search any
task
Search any
task