Share your thoughts, 1 month free Claude Pro on usSee more

Graph Optimization on FORGE-BENCH

100Success Rate (SR)

gpt-o3

Updated 22d ago

Evaluation Results

Method
gpt-o3 2026.05	100	51.4
Qwen3-235B-Thinking 2026.05	100	55.8
Qwen3-235B-Instruct 2026.05	100	50.4
gpt-4o-2024-08-06 2026.05	100	53
Qwen2.5-32B 2026.05	100	51.7
FORGE-7B-NP-MATH 2026.05	100	51.8
Qwen3-30B-A3B 2026.05	99	51.2
Qwen3-32B 2026.05	99	52.6
FORGE-7B-NP 2026.05	99	53.8
DS-V3.1-Thinking 2026.05	98	77.1
Qwen3-8B 2026.05	98	51
gpt-o3 2026.05	97	86.4
DS-R1-Qwen-32B 2026.05	96	48.6
QWEN2.5-7B-SFT 2026.05	96	49.7
FORGE-7B-NP 2026.05	93.1	46.6
gpt-o3 2026.05	91.5	76.9
FORGE-7B-NP-MATH 2026.05	91.3	51.3
Qwen2.5-72B 2026.05	90	39.5
FORGE-7B-NP 2026.05	89.7	27.8
FORGE-7B-NP-MATH 2026.05	89	32.2
Qwen2.5-14B 2026.05	89	44.3
DS-V3.1-Thinking 2026.05	88.8	79.9
DS-V3.1-Thinking 2026.05	86	78.2
InternLM3-8b 2026.05	86	43.3
Qwen3-235B-Thinking 2026.05	82.3	70.7
Qwen3-30B-A3B 2026.05	76.8	64.1
Qwen3-32B 2026.05	70.7	57.6
Qwen2.5-7B 2026.05	67	34
Qwen3-235B-Thinking 2026.05	66.7	62.9
Qwen3-235B-Instruct 2026.05	65.4	50.2
gpt-4o-2024-08-06 2026.05	64.7	29.3
gpt-4o-2024-08-06 2026.05	62.1	36.2
Qwen3-8B 2026.05	57.5	45.4
Qwen3-30B-A3B 2026.05	57.3	50.6
QWEN2.5-7B-SFT 2026.05	56.8	43
DS-R1-Qwen-32B 2026.05	53.9	39.9
Qwen3-235B-Instruct 2026.05	47	37.9
Qwen3-32B 2026.05	44.7	39.3
Qwen2.5-72B 2026.05	43.4	26.5
Qwen2.5-32B 2026.05	41.2	21.8
Qwen2.5-14B 2026.05	36.2	17.8
InternLM3-8b 2026.05	35.7	16.8
Qwen2.5-32B 2026.05	35.3	15.2
QWEN2.5-7B-SFT 2026.05	35	29.3
DS-R1-Qwen-14B 2026.05	34.8	29.2
Qwen2.5-72B 2026.05	34.7	15.2
DS-R1-Qwen-14B 2026.05	32	16.2
Qwen2.5-14B 2026.05	30	11.5
Qwen2.5-7B 2026.05	29.6	14.6
DS-R1-Qwen-32B 2026.05	23.3	18.1
LLama3.1-8B 2026.05	23	8
Qwen3-8B 2026.05	22.7	16.8
DS-R1-Qwen-14B 2026.05	18	13.4
LLama3.1-8B 2026.05	15.1	5.8
InternLM3-8b 2026.05	15	3.6
Qwen2.5-3B 2026.05	13.8	4.9
Qwen2.5-7B 2026.05	11	3.1
Qwen2.5-3B 2026.05	7.7	2.9
DS-R1-Qwen-7B 2026.05	6.3	1.9
Qwen2.5-3B 2026.05	6	2.2
DS-R1-Qwen-7B 2026.05	4.7	2.5
DS-R1-Qwen-7B 2026.05	2	1
LLama3.1-8B 2026.05	0	0