Share your thoughts, 1 month free Claude Pro on usSee more

Diacritization on Custom Hebrew Diacritization Corpus

86.86Macro Accuracy

DictaLM-3.0-24B-Thinking

Updated 4mo ago

Evaluation Results

Method	Links
DictaLM-3.0-24B-Thinking 2026.02		86.86
DictaLM-3.0-Nemotron-12B-Instruct 2026.02		76.12
gemma3-27B-it 2026.02		60.21
DictaLM-3.0-1.7B-Instruct 2026.02		52.76
gemma-3-12b-it 2026.02		51.78
DictaLM-3.0-1.7B-Thinking 2026.02		47.2
aya-expanse-32B 2026.02		45.4
Qwen3-14B (think) 2026.02		4.73
Llama-3.3-70B-Instruct 2026.02		4.05
gemma-3-1b-it 2026.02		3.44
Qwen3-1.7B (think) 2026.02		2.93