Share your thoughts, 1 month free Claude Pro on usSee more

Multilingual Language Understanding on MMMLU (Massive Multilingual Language Understanding)

79.5Accuracy

Qwen-3-30B-A3B

Updated 1mo ago

Evaluation Results

Method	Links
Qwen-3-30B-A3B 2026.02		79.5
Qwen-3-32B 2026.02		79
Llama-3.3-70B 2026.02		78.4
Mistral-3.2-24B 2026.02		74.8
Qwen-3-14B 2026.02		74.7
Gemma-3-27B 2026.02		74.6
Gemma-3-12B 2026.02		69
OLMo-3.1-32B 2026.02		66.5
EuroLLM-22B (new) 2026.02		64.1
Apertus-70B 2026.02		60.3
EuroLLM-9B (new) 2026.02		60.2
EuroLLM-22B (old) 2026.02		59.7
Qwen2.5-VL-3B 2025.11		54.23
EuroLLM-9B (old) 2026.02		53.8
LFM2-VL-3B 2025.11		53.37
Apertus-8B 2026.02		53
Llama-3.1-8B 2026.02		52.9
InternVL3.5-2B 2025.11		49.32
OLMo-3-7B 2026.02		48.3
Qwen3-VL-2B 2025.11		42.2
SmolVLM2-2.2B 2025.11		32.16