Share your thoughts, 1 month free Claude Pro on usSee more

Summarization on Custom Hebrew Summarization (test)

56.86Win Rate (GPT-4o)

DictaLM-3.0-24B-Thinking

Updated 3mo ago

Evaluation Results

Method	Links
DictaLM-3.0-24B-Thinking 2026.02		56.86
gemma3-27B-it 2026.02		44.54
gemma-3-12b-it 2026.02		39.48
Llama-3.3-70B-Instruct 2026.02		37.83
DictaLM-3.0-Nemotron-12B-Instruct 2026.02		33.27
aya-expanse-32B 2026.02		29.46
Qwen3-14B (think) 2026.02		15.83
DictaLM-3.0-1.7B-Thinking 2026.02		10.22
DictaLM-3.0-1.7B-Instruct 2026.02		9.72
Qwen3-1.7B (think) 2026.02		0.4
gemma-3-1b-it 2026.02		0.35