Share your thoughts, 1 month free Claude Pro on usSee more

Chain-of-Thought Reasoning on Reasoning Dataset

86.9Accuracy (Acc)

Qwen3-30B-A3B-Thinking-2507

Updated 1mo ago

Evaluation Results

Method
Qwen3-30B-A3B-Thinking-2507 2026.03	86.9	5,077.3	93.1	0.019	145.7	1.656	5.67	5.34	11.4	13.2	12	68.8	68.4
Qwen3-235B-A22B-Thinking-2507 2026.03	86.8	5,823	117.4	0.02	178.4	1.6	5.53	5.23	10	12.9	12.3	69.3	60.8
Doubao-Seed-1.6 2026.03	85.5	1,462.3	26	0.003	41.7	1.661	3.72	3.54	10.2	7.4	9.6	50.2	17.1
Qwen3-Max 2026.03	85.3	6,954.8	181.2	0.105	265	1.617	1.59	1.64	15	12.3	46.8	86.5	95.5
DeepSeek-V3.2 2026.03	83.2	1,794.3	45.9	0.068	63.9	1.484	3.1	2.95	9.8	7.5	10.3	58	38.2
DeepSeek-R1 2026.03	82.8	4,313.4	149.8	0.03	233	1.749	6.84	6.7	11.2	7	12.4	78	63.6
gpt-oss-120b 2026.03	82.4	1,080.1	21.5	0.033	28.2	1.331	2.65	2.51	8.8	4.4	9.1	33.6	16.4
GLM-4.6 2026.03	82.1	2,673.6	61.8	0.048	101.7	1.668	5.37	5	11.2	5.9	8.8	66.7	64.6
DeepSeek-R1-0528-Qwen3-8B 2026.03	80.8	8,816.8	303.1	0.059	449.1	1.677	6.21	6	13.9	11.8	12.3	74.2	82
Doubao-Seed-1.6-Flash-Thinking 2026.03	80.3	2,756	35.8	0.004	59.9	1.761	4.41	4.21	12.3	7.2	9.8	54.9	24.1
Gemini-2.5-Flash-Thinking 2026.03	79.7	5,146.6	13.4	0.027	15.7	1.23	3.1	2.8	3.3	7.7	8.9	37.7	3.7
DeepSeek-R1-Distill-Llama-70B 2026.03	79.6	3,402.8	91.9	0.026	152.1	1.964	6.31	6.31	14.7	8.2	10.1	72.5	69.4
Gemini-2.5-Pro 2026.03	78.9	3,557	13	0.032	14.8	1.229	3	2.9	5	6.9	8.9	39.3	7.3
Kimi-K2-Thinking 2026.03	77.8	2,474.4	42.1	0.031	69.1	1.784	5.74	5.4	14.9	6	8.6	68.7	56.1
Claude-Sonnet-4.5 2026.03	77.5	450.5	21.8	0.012	24	1.138	2.71	2.59	8.7	8.2	11.9	36.8	3.1
gpt-oss-20b 2026.03	75.8	2,185.6	34.4	0.051	51.5	1.367	2.44	2.32	8.1	9.5	8.8	49.8	36.6
DeepSeek-R1-Distill-Qwen-14B 2026.03	71.7	3,256.1	96.2	0.035	142	1.409	5.79	5.57	11	8	11.2	75.4	42.7
DeepSeek-R1-Distill-Qwen-32B 2026.03	70.8	2,141	63.5	0.038	91.9	1.275	4.34	4.2	8.1	5.9	11.1	69.9	28.2
Gemini-3-Pro 2026.03	70.3	4,160.4	10.7	0.04	11.2	1.129	2.06	1.94	5	15.3	7	33.3	4.9
DeepSeek-R1-Distill-Llama-8B 2026.03	59.8	5,090.6	159.2	0.025	225.7	1.583	4.9	4.81	11.7	10.8	12.2	75.3	62.6
DeepSeek-R1-Distill-Qwen-7B 2026.03	56	3,596.5	108.7	0.038	153.2	1.442	4.77	4.53	11.8	8.3	12.9	71	51.2