Share your thoughts, 1 month free Claude Pro on usSee more

Multiple-choice Question Answering on Bangla MMLU 1.0 (test)

35Accuracy

Qwen-2.5-1.5b

Updated 1mo ago

Evaluation Results

Method	Links
Qwen-2.5-1.5b 2025.02		35
Llama-3.2-3b 2025.02		34
Llama-3.2-3b 2025.02		33
Qwen-2.5-1.5b 2025.02		33
BongLLaMA-3.2-3b 2025.02		33
Gemma-2-2b 2025.02		32
Qwen-2.5-0.5b 2025.02		31
davinci 2025.02		30
Qwen-2.5-0.5b 2025.02		30
SmolLM2-1.7b 2025.02		30
BongLLaMA-3.2-3b 2025.02		30
Gemma-2-2b 2025.02		29
SmolLM2-1.7b 2025.02		29
Llama-3.2-1b 2025.02		28
Llama-3.2-1b 2025.02		28
BLOOM-1b7 2025.02		27
BLOOM-1b7 2025.02		27
BLOOM-1b1 2025.02		26
BLOOM-3b 2025.02		26
BongLLaMA-3.2-1b 2025.02		26
SmolLM2-360m 2025.02		25
BongLLaMA-3.2-1b 2025.02		25
TituLLM-1b-v2.0 2025.02		25
TituLLM-1b-v2.0 2025.02		25
TituLLM-3b-v2.0 2025.02		25
TituLLM-3b-v2.0 2025.02		25
SmolLM2-360m 2025.02		24
SmolLM2-135m 2025.02		23
SmolLM2-135m 2025.02		23
BLOOM-560m 2025.02		23
BLOOM-560m 2025.02		23
BLOOM-1b1 2025.02		23
BLOOM-3b 2025.02		23