Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Math & Code Reasoning on ARC Easy
Loading...
81.1
Score
Llama 3-8B
25.044
39.597
54.15
68.703
May 29, 2026
Jun 1, 2026
Jun 4, 2026
Jun 7, 2026
Jun 10, 2026
Jun 13, 2026
Jun 17, 2026
Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
Score
Llama 3-8B
Paradigm=AR, Training...
2026.06
81.1
Llama 2-7B
Paradigm=AR, Training...
2026.06
73.8
LLaDA-8B
Paradigm=Masked Diffus...
2026.06
71.8
Falcon-7B
Paradigm=AR, Training...
2026.06
70.8
Sumi-7B
Paradigm=Uniform Diffu...
2026.06
70
OLMo-7B
Paradigm=AR, Training...
2026.06
68.8
DiReCT
Backbone=Llama-1.1B
2026.05
47
GradNorm (IS)
Backbone=Llama-1.1B
2026.05
44.3
InfoBatch
Backbone=Llama-1.1B
2026.05
43.7
Perplexity-based
Backbone=Llama-1.1B
2026.05
42.4
Uniform Sampling
Backbone=Llama-1.1B
2026.05
41.3
Loss-based
Backbone=Llama-1.1B
2026.05
41
DiReCT
Backbone=GPT-2-Medium...
2026.05
34
InfoBatch
Backbone=GPT-2-Medium...
2026.05
31.7
GradNorm (IS)
Backbone=GPT-2-Medium...
2026.05
30.6
Perplexity-based
Backbone=GPT-2-Medium...
2026.05
29.8
Loss-based
Backbone=GPT-2-Medium...
2026.05
28.4
Uniform Sampling
Backbone=GPT-2-Medium...
2026.05
27.2
Feedback
Search any
task
Search any
task