Share your thoughts, 1 month free Claude Pro on usSee more

Yes/No Reading Comprehension on BoolQ 1.0 (test)

69Normalized Accuracy

Llama-3.2-3b

Updated 1mo ago

Evaluation Results

Method	Links
Llama-3.2-3b 2025.02		69
Qwen-2.5-1.5b 2025.02		68
Qwen-2.5-1.5b 2025.02		62
Gemma-2-2b 2025.02		60
BLOOM-1b7 2025.02		59
Llama-3.2-1b 2025.02		58
Qwen-2.5-0.5b 2025.02		58
BLOOM-1b1 2025.02		58
Gemma-2-2b 2025.02		56
BLOOM-1b1 2025.02		56
SmolLM2-1.7b 2025.02		55
BongLLaMA-3.2-3b 2025.02		54
TituLLM-3b-v2.0 2025.02		54
davinci 2025.02		53
Llama-3.2-1b 2025.02		53
Llama-3.2-3b 2025.02		53
Qwen-2.5-0.5b 2025.02		53
SmolLM2-135m 2025.02		53
SmolLM2-360m 2025.02		53
SmolLM2-1.7b 2025.02		53
BLOOM-560m 2025.02		53
BLOOM-560m 2025.02		53
BLOOM-1b7 2025.02		53
BLOOM-3b 2025.02		53
BLOOM-3b 2025.02		53
BongLLaMA-3.2-1b 2025.02		53
BongLLaMA-3.2-1b 2025.02		53
BongLLaMA-3.2-3b 2025.02		53
TituLLM-1b-v2.0 2025.02		53
TituLLM-3b-v2.0 2025.02		53
SmolLM2-360m 2025.02		52
SmolLM2-135m 2025.02		51
TituLLM-1b-v2.0 2025.02		51