Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
General Reasoning and Coding on PopQA Non-Factoid
Loading...
51.4
GSM8K Accuracy
REMIX (Random / -)
15.416
24.758
34.1
43.442
Nov 11, 2024
GSM8K Accuracy
MATH Accuracy
EC Accuracy
APPS Accuracy
UC Accuracy
Average Accuracy
Updated 27d ago
Evaluation Results
Method
Method
Links
GSM8K Accuracy
MATH Accuracy
EC Accuracy
APPS Accuracy
UC Accuracy
Average Accuracy
REMIX (Random / -)
Backbone=Llama-3-8B, M...
2024.11
51.4
89.3
82.7
81.8
66
72.2
REMIX (K-Pile / -)
Backbone=Llama-3-8B, M...
2024.11
46.4
92.7
94
87.2
90.9
82.2
REMIX (Random / K-Pile)
Backbone=Llama-3-8B, M...
2024.11
38.5
88.7
88.3
79.2
74.4
73.8
REMIX (- / K-Pile)
Backbone=Llama-3-8B, M...
2024.11
25.9
94
92.4
73.9
74.7
72.2
No Mixing
Backbone=Llama-3-8B, M...
2024.11
19
92.4
77
55.1
48.5
58.4
REMIX (- / Random)
Backbone=Llama-3-8B, M...
2024.11
16.8
93.5
87.5
59.3
70.7
65.6
Feedback
Search any
task
Search any
task