Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Reasoning Question Answering on StrategyQA (ACC & AUC)
Loading...
80
Accuracy
DIRECT QUERY
47.76
56.13
64.5
72.87
Dec 30, 2023
Accuracy
AUC
Updated 9d ago
Evaluation Results
Method
Method
Links
Accuracy
AUC
DIRECT QUERY
PRIVATE=NO, Backbone=G...
2023.12
80
80
DIRECT QUERY
PRIVATE=NO, Backbone=G...
2023.12
79
78
CONFUSIONPROMPT
PRIVATE=YES, Backbone=...
2023.12
74
74
CONFUSIONPROMPT
PRIVATE=YES, Backbone=...
2023.12
73
74
CONFUSIONPROMPT
PRIVATE=YES, Backbone=...
2023.12
72
73
DIRECT QUERY
PRIVATE=NO, Backbone=G...
2023.12
71
74
VICUNA-13B
PRIVATE=YES
2023.12
65
63
LLAMA2-7B
PRIVATE=YES
2023.12
60
58
PARAPHRASER
PRIVATE=YES, Backbone=...
2023.12
56
53
TEXT2TEXT
PRIVATE=YES, Backbone=...
2023.12
54
51
TEXT2TEXT
PRIVATE=YES, Backbone=...
2023.12
53
51
TEXT2TEXT
PRIVATE=YES, Backbone=...
2023.12
53
50
PARAPHRASER
PRIVATE=YES, Backbone=...
2023.12
53
51
PARAPHRASER
PRIVATE=YES, Backbone=...
2023.12
49
48
Feedback
Search any
task
Search any
task