Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Multiple Choice Question Answering on QASC (test)
Loading...
78.5
Accuracy
UnifiedQA 11B
22.392
36.9585
51.525
66.0915
Apr 30, 2022
May 30, 2022
Jun 29, 2022
Jul 30, 2022
Aug 29, 2022
Sep 28, 2022
Oct 29, 2022
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
UnifiedQA 11B
Model=UnifiedQA 11B
2022.10
78.5
TEAM
Backbone=DeBERTa Large
2022.10
74.35
Score
Backbone=DeBERTa Large
2022.10
71.74
UnifiedQA_T5-FT
Model Size=LARGE, Prot...
2022.04
58.71
GenMC_T5
Model Size=LARGE
2022.04
58.06
TEAM
Backbone=RoBERTa Large
2022.10
53.8
RoBERTa
Model Size=LARGE
2022.04
50.22
Score
Backbone=RoBERTa Large
2022.10
46.52
UnifiedQA_T5
Model Size=LARGE
2022.04
43.74
UnifiedQA_T5*
Model Size=LARGE, Refe...
2022.04
43.3
UnifiedQA_T5-FT
Model Size=BASE, Proto...
2022.04
43.2
GenMC_T5
Model Size=BASE
2022.04
41.72
RoBERTa
Model Size=BASE
2022.04
34.38
ALBERT
Model Size=LARGE
2022.04
33.12
UnifiedQA_T5
Model Size=BASE
2022.04
25.7
ALBERT
Model Size=BASE
2022.04
24.55
Feedback
Search any
task
Search any
task