Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on AIME24 (test)

98.9Pass@1 Score

MiroThinker-v1.5

Updated 12d ago

Evaluation Results

Method
MiroThinker-v1.5 2026.05	98.9	-
GPT-5.4-xhigh 2026.05	96.4	-
SR2AM-v1.0-30B 2026.05	96.2	-
DeepSeek-V3.2 2026.05	95.4	-
GPT-5.4-xhigh 2026.05	95.2	-
DeepSeek-V3.2 2026.05	95.1	-
K2-Think-V2-high 2026.05	93.8	-
ASearcher-Web-QWQ-v2 2026.05	92.2	-
Qwen3-30B-A3B 2026.05	91.3	-
Kimi-K2.5 2026.05	89.6	-
Tongyi-DeepResearch 2026.05	89.2	-
SR2AM-v0.1-8B 2026.05	83.8	-
GPT-OSS-120B-high 2026.05	79.9	-
WebExplorer-8B 2026.05	79.5	-
Qwen3-235B 2026.05	75.5	-
w/o Merging 2026.02	74.27	-
SCF-RKL 2026.02	73.96	-
Qwen3-30B-A3B 2026.05	73.9	-
WebSailor-32B 2026.05	72.9	-
w/o Merging 2026.02	72.5	-
GLM-4.6 2026.05	71.7	-
A2FM 2026.05	70.3	-
SCE 2026.02	65.62	-
Ties Merging 2026.02	63.23	-
Dare Task Arithmetic 2026.02	62.92	-
Task Arithmetic 2026.02	61.98	-
Dare Ties Merging 2026.02	61.88	-
WebSailor-7B 2026.05	60.6	-
RAgent-QwQ-32B 2025.01	56.7	-
Search-o1 2025.01	56.7	-
QwQ-32B 2025.01	53.3	-
DeepSeek-R1-Lite 2025.01	52.5	-
RAG-QwQ-32B 2025.01	50	-
SimpleTIR-32B 2026.05	49.2	-
o1-preview 2025.01	44.6	-
DeepSeek-R1-Distill-Qwen-7B 2026.04	43.3	7,891.9
AFM-Code-7B-RL 2026.05	39.7	-
Llama3.3-70B 2025.01	36.7	-
Task Arithmetic 2026.04	36.7	6,580.9
Evo-L2S (Accuracy) 2026.04	36.7	6,674.3
Evo-L2S-01 2026.04	36.7	6,674.3
Evo-L2S-02 2026.04	33.3	4,948.4
SimpleTIR-7B 2026.05	33.3	-
RAG-Qwen2.5-32B 2025.01	30	-
ACM-TA 2026.04	30	3,898.1
Evo-L2S-03 2026.04	30	3,140.9
AFM-Web-7B-RL 2026.05	24.8	-
Qwen2.5-32B 2025.01	23.3	-
TIES-Merging 2026.04	23.3	4,266.5
Evo-L2S-04 2026.04	23.3	3,368.4
Qwen2.5-Coder-32B 2025.01	20	-
Qwen2.5-72B 2025.01	20	-
RAgent-Qwen2.5-32B 2025.01	20	-
ACM-Average 2026.04	20	2,951.5
Evo-L2S-05 2026.04	20	2,006.6
Average Merging 2026.04	16.7	3,710.7
ACM-TIES 2026.04	16.7	3,118.6
Evo-L2S (Length) 2026.04	16.7	2,038.9
ASearcher-Web-7B 2026.05	12.9	-
GPT-4o 2025.01	9.3	-
Qwen2.5-Math-7B 2026.04	0	1,450