Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Zero-shot Question Answering on MMLU
Loading...
1.03
Average Loss
Pre-trained
1.0284
1.0392
1.05
1.0608
Nov 22, 2024
Average Loss
Ambiguity
Ensemble Loss
NLL
Error Rate
ECE
Updated 1mo ago
Evaluation Results
Method
Method
Links
Average Loss
Ambiguity
Ensemble Loss
NLL
Error Rate
ECE
Pre-trained
Model=LLaMa-3, # Param...
2024.11
1.03
-
1.03
1.03
36.1
16
LPE-BSR
Model=LLaMa-3, # Param...
2024.11
1.07
0.049
1.02
0.923
36.4
8.7
Feedback
Search any
task
Search any
task