Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on ARC Easy (Accuracy, Std, Speedup)
Loading...
93.2
Accuracy
TALE
73.024
78.262
83.5
88.738
Oct 26, 2025
Accuracy
Std Dev
Speedup
Updated 22d ago
Evaluation Results
Method
Method
Links
Accuracy
Std Dev
Speedup
TALE
Backbone=Qwen 2.5 7B,...
2025.10
93.2
16
-10
TALE
Backbone=LLaMA 3.1 8B,...
2025.10
90.4
14
-14.6
BSBA
Backbone=Qwen 2.5 7B,...
2025.10
90.08
-
-30.3
Baseline
Backbone=Qwen 2.5 7B,...
2025.10
90.04
-
-
Baseline
Backbone=LLaMA 3.1 8B,...
2025.10
89
-
-
BSBA
Backbone=LLaMA 3.1 8B,...
2025.10
88.8
-
-23.5
TALE
Backbone=Mistral 7B, E...
2025.10
85.6
14
-15.4
Baseline
Backbone=Mistral 7B, E...
2025.10
83.8
-
-
BSBA
Backbone=Mistral 7B, E...
2025.10
82.8
-
-27.7
TALE
Backbone=Lucie 7B, Eva...
2025.10
75.8
15
-18.1
Baseline
Backbone=Lucie 7B, Eva...
2025.10
74.4
-
-
BSBA
Backbone=Lucie 7B, Eva...
2025.10
73.8
-
-23.5
Feedback
Search any
task
Search any
task
