Share your thoughts, 1 month free Claude Pro on usSee more

Chat Evaluation on AlpacaEval LC 2

74.11Score

DictaLM 3.0 24B-Think

Updated 1mo ago

Evaluation Results

Method	Links
DictaLM 3.0 24B-Think 2026.02		74.11
Qwen 3 VL 8B Think 2025.12		73.5
Qwen 3 VL 8B Inst 2025.12		73.5
Gemma 3 27B 2026.02		65.5
Qwen 3 8B 2025.12		60.5
Nemotron Nano 9B v2 2025.12		58
Olmo 3 7B Think 2025.12		52.1
Olmo 3 7B Think 2025.12		50.6
Gemma 3 12B 2026.02		50.57
Qwen 3 8B 2025.12		49.8
Olmo 3 7B Think 2025.12		43.9
Olmo 3 7B Instruct 2025.12		43.3
Mistral Small 3.1 2026.02		41.22
Olmo 3 7B Instruct 2025.12		40.9
Granite 3.3 8B Inst 2025.12		28.6
OpenThinker3 7B 2025.12		24
Qwen 2.5 7B 2025.12		23
Olmo 3 7B Instruct 2025.12		21.8
OLMo 2 7B Inst 2025.12		18.3
DictaLM 3.0 12B-Inst 2026.02		17.45
OR Nemotron 7B 2025.12		8.6
Apertus 8B Inst 2025.12		8.1
DS-R1 Qwen 7B 2025.12		7.7