Share your thoughts, 1 month free Claude Pro on usSee more

Planning Accuracy on Blocksworld (test)

98.2Accuracy

DeepSeek-R1

Updated 18d ago

Evaluation Results

Method	Links
DeepSeek-R1 2026.07		98.2
o1-preview 2026.07		97.8
PT-SFT 2026.05		97
PT-SFT 2026.05		96
PT-SFT 2026.05		93
QwQ-32B 2026.07		88.8
HyperGuide 2026.05		87
HyperGuide 2026.05		83
SoftCoT 2026.05		82
OVM 2026.05		81.4
SoftCoT 2026.05		79
OVM 2026.05		77.4
Qwen3-8B 2026.07		77.2
HyperGuide 2026.05		76
Qwen3-8B 2026.07		73.8
SoftCoT 2026.05		71
OVM 2026.05		62
Self-Consistency 2026.05		60
Tree of Thoughts 2026.05		58
Few-shot 2026.05		57
Tree of Thoughts 2026.05		55
Self-Consistency 2026.05		53
DeepSeek-R1-Distill-Llama-8B 2026.07		52.6
DeepSeek-V3 2026.07		44.8
GPT-4o 2026.07		42.4
DeepSeek-R1-Distill-Llama-8B 2026.07		42
Few-shot 2026.05		41
Tree of Thoughts 2026.05		37
Qwen3-8B 2026.07		31.2
Llama-3.1-70B-Instruct 2026.07		21.6
Qwen2.5-72B-Instruct 2026.07		13.8
Few-shot 2026.05		9
Self-Consistency 2026.05		2
DeepSeek-R1-Distill-Llama-8B 2026.07		1.4
Llama-3.1-8B-Instruct 2026.07		0.6