Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Reading Comprehension on BoolQ and DROP
Loading...
81.1
BoolQ Accuracy
OLMoE-1B-7B
40.956
51.378
61.8
72.222
May 26, 2026
BoolQ Accuracy
DROP Accuracy
Updated 7d ago
Evaluation Results
Method
Method
Links
BoolQ Accuracy
DROP Accuracy
OLMoE-1B-7B
Nact/Ntotal=1.3B/6.9B,...
2026.05
81.1
29.3
MobileMoE-L
Nact/Ntotal=922M/5.3B,...
2026.05
81.1
50.1
MobileMoE-M
Nact/Ntotal=528M/2.8B,...
2026.05
76.7
46.6
Gemma 3 1B
Nact/Ntotal=1.0B, Mode...
2026.05
75.8
22
MobileMoE-S
Nact/Ntotal=272M/1.3B,...
2026.05
72.3
32.3
Qwen3.5 2B
Nact/Ntotal=1.9B, Mode...
2026.05
71.7
44.7
Llama 3.2 1B
Nact/Ntotal=1.2B, Mode...
2026.05
71.6
21.5
OLMo 2 1B
Nact/Ntotal=1.5B, Mode...
2026.05
71
31.2
MobileLLM-Pro
Nact/Ntotal=1.1B, Mode...
2026.05
68.8
25.5
SmolLM2 1.7B
Nact/Ntotal=1.7B, Mode...
2026.05
68.5
24.8
Qwen3.5 0.8B
Nact/Ntotal=749M, Mode...
2026.05
62.5
33.3
Gemma 3 270M
Nact/Ntotal=270M, Mode...
2026.05
56.1
11
SmolLM2 360M
Nact/Ntotal=362M, Mode...
2026.05
42.5
15.2
Feedback
Search any
task
Search any
task