Competition Math Evaluation Suite (AIME, Brumo, HMMT)

71.2AIME Score

ParaGator-4B-Instruct-Principia + aggregation

Updated 29d ago

Evaluation Results

Method
ParaGator-4B-Instruct-Principia + aggregation 2026.03	71.2	46.65	66.28	61.38
Online Multitask + aggregation 2026.03	64.24	45.26	67.33	58.94
Dr.GRPO (with KL) + aggregation 2026.03	63.65	47.29	65.52	58.79
Offline aggregation (AggLM) + aggregation 2026.03	62.42	43.16	65.14	56.91
ParaGator-4B-Instruct-Principia 2026.03	59.44	42.32	59.67	53.81
Online Multitask 2026.03	58.36	41.73	59.45	53.18
Dr.GRPO (with KL) 2026.03	58.02	44.69	61.56	54.2
Qwen3-4B-Instruct-2507 + aggregation 2026.03	56.46	35.94	61.88	51.43
Offline aggregation (AggLM) 2026.03	51.06	37.47	54.91	47.81
Qwen3-4B-Instruct-2507 2026.03	47.71	30.83	55.42	44.65
ParaGator-Zero-4B-Principia + aggregation 2026.03	27.96	31.06	-	23.72
Online Multitask + aggregation 2026.03	26.19	29.54	14.11	23.28
Dr.GRPO + aggregation 2026.03	25.95	31.07	13.1	23.37
ParaGator-Zero-4B-Principia 2026.03	21.05	22.58	7.04	16.89
Dr.GRPO 2026.03	20.93	23.19	8.14	17.42
Online Multitask 2026.03	19.14	22.37	7.98	16.5
Offline aggregation (AggLM) + aggregation 2026.03	16.91	25.65	12.4	18.32
Qwen3-4B-Base + aggregation 2026.03	10.3	14.25	2.5	9.02
Offline aggregation (AggLM) 2026.03	9.13	17.11	7.42	11.22
Qwen3-4B-Base 2026.03	8.2	16.67	3.2	9.36