Share your thoughts, 1 month free Claude Pro on usSee more

Logical Reasoning on SLR-BENCH Extended Leaderboard

15.5LRL Score

Updated 21d ago

Evaluation Results

Method
o3 2025.06	15.5	80	99	93	74	45
gpt-5 2025.06	15.4	98	100	90	72	46
gpt-5-mini-high 2025.06	14.2	94	99	83	63	38
o4-mini-high 2025.06	12.8	88	98	96	40	21
o4-mini 2025.06	12.3	86	93	88	52	13
gpt-5-mini 2025.06	12	95	99	82	41	20
o1 2025.06	11.9	68	92	89	41	15
o3-mini 2025.06	11.6	75	97	90	37	7
Qwen3-235B-A22B-Thinking-2507 2025.06	10.4	89	82	76	38	12
o4-mini-low 2025.06	10.3	91	91	81	25	9
Qwen3-235B-A22B-Instruct-2507 2025.06	10.3	100	99	76	20	10
o1-mini 2025.06	10.1	95	97	82	20	3
gpt-5-mini-low 2025.06	9.7	88	97	71	20	7
Qwen3-Next-80B-A3B-Thinking 2025.06	9.6	96	93	73	18	8
Qwen3-32B 2025.06	9	100	97	64	14	6
Qwen3-30B-A3B-Thinking-2507 2025.06	9	97	97	67	14	3
Qwen3-VL-30B-A3B-Thinking 2025.06	8.9	83	94	70	12	3
Qwen3-Next-80B-A3B-Instruct 2025.06	8.8	100	93	64	15	5
R1-Llama-70B 2025.06	8.8	75	98	67	8	4
Gemini-thinking 2025.06	8.6	83	93	65	13	1
gpt-5-nano 2025.06	8.5	99	97	61	10	2
Qwen3-VL-32B-Thinking 2025.06	8.4	99	86	66	14	3
Qwen3-4B-Thinking-2507 2025.06	8.1	99	98	56	8	2
Qwen3-30B-A3B-Instruct-2507 2025.06	8	100	95	57	5	3
Qwen3-30B-A3B 2025.06	7.9	100	93	57	7	1
Qwen3-VL-8B-Thinking 2025.06	7.7	97	87	55	9	2
Qwen3-8B 2025.06	7.6	100	93	50	7	3
Qwen3-VL-4B-Thinking 2025.06	7.6	86	91	52	6	2
Qwen3-14B 2025.06	7.5	100	88	53	8	2
gpt-4.5-prev 2025.06	7.3	100	94	47	5	1
Qwen3-4B 2025.06	6.9	99	91	41	5	1
Qwen3-4B-Instruct-2507 2025.06	6.6	100	73	50	6	2
Qwen3-235B-A22B 2025.06	6.5	100	87	41	3	0
gpt-4o 2025.06	6.2	100	93	29	2	0
Qwen3-32B 2025.06	5.9	100	89	28	2	0
Qwen3-14B 2025.06	5.6	100	86	25	2	0
Llama 3.3-70B 2025.06	5.6	100	90	22	1	0
gpt-4-turbo 2025.06	5.4	100	89	18	2	0
Qwen3-Coder-30B-A3B-Instruct 2025.06	5.3	100	88	17	2	0
Qwen3-30B-A3B 2025.06	5.2	100	85	19	1	0
Qwen3-8B 2025.06	4.6	100	78	15	0	0
Qwen3-4B 2025.06	4.1	100	70	12	1	0
Llama 3.1-8B 2025.06	3.8	80	70	7	0	0
Qwen3-VL-30B-A3B-Instruct 2025.06	3.7	100	71	4	0	0
Qwen3-VL-32B-Instruct 2025.06	3.5	100	68	2	0	0
Qwen3-VL-8B-Instruct 2025.06	3.3	99	65	1	0	0
Qwen3-1.7B 2025.06	1.9	100	35	4	0	0
Qwen3-VL-2B-Instruct 2025.06	1.8	58	36	0	0	0
Qwen3-0.6B 2025.06	1.5	80	30	0	0	0
Llama 3.2-3B 2025.06	1	25	19	1	0	0
Qwen3-VL-2B-Thinking 2025.06	0.4	87	8	0	0	0
Qwen3-1.7B 2025.06	0.3	95	6	1	0	0
Qwen3-0.6B 2025.06	0.2	98	4	0	0	0
Llama 3.2-1B 2025.06	0	93	0	0	0	0