Share your thoughts, 1 month free Claude Pro on usSee more

Reasoning on GSM8K, MATH-500, AIME24, AIME25, GPQA-D

95.15GSM8K Accuracy

BF16

Updated 1mo ago

Evaluation Results

Method
BF16 2026.03	95.15	96.87	71.46	63.12	58.13	76.95	100
SmoothQuant 2026.03	94.92	96.27	65.62	56.04	54.8	73.53	94.8
BATQuant 2026.03	94.84	96.4	68.33	59.38	57.22	75.23	97.46
BATQuant 2026.03	94.77	95.6	62.08	52.92	54.19	71.91	92.45
BATQuant 2026.03	94.77	95.27	66.04	54.48	54.24	72.96	94
SpinQuant 2026.03	94.69	95.53	60.42	51.46	54.58	71.34	91.62
SmoothQuant 2026.03	94.69	95.33	60.71	47.29	52.42	70.09	89.6
BRQ 2026.03	94.69	95.33	63.75	52.71	54.04	72.1	92.72
FlatQuant 2026.03	94.62	95.93	69.17	57.08	54.8	74.32	95.99
BATQuant 2026.03	94.62	96.27	69.37	55.21	56.82	74.46	96.22
FlatQuant 2026.03	94.54	96	65.42	53.96	54.55	72.89	93.87
QuaRot 2026.03	94.47	95.67	64.17	55.63	54.39	72.87	93.91
SpinQuant 2026.03	94.47	95.47	59.38	53.96	55.86	71.87	92.56
GPTQ 2026.03	94.47	96.13	65	57.08	53.94	73.32	94.54
GPTQ 2026.03	94.39	96.33	68.02	59.38	55.1	74.64	96.54
SmoothQuant 2026.03	94.39	96.13	66.04	54.79	54.29	73.13	94.21
GPTQ 2026.03	94.24	95.73	57.5	52.08	52.12	70.33	90.1
QuaRot 2026.03	94.09	92.47	47.5	39.37	48.13	64.31	81.2
QuaRot 2026.03	94.09	95.73	64.79	55.83	54.49	72.99	94.11
FlatQuant 2026.03	94.09	95.4	63.33	53.54	54.95	72.26	93.07
QuaRot 2026.03	94.01	94.8	62.08	52.5	51.82	71.04	91.17
RTN 2026.03	93.78	95	60.21	54.79	53.54	71.46	91.96
RTN 2026.03	93.71	95.53	64.58	55	54.39	72.64	93.64
BRQ 2026.03	93.71	95.8	63.96	53.33	55.4	72.39	93.26
BRQ 2026.03	93.56	95.13	62.08	49.17	53.54	70.7	90.68
SpinQuant 2026.03	93.4	91.67	38.57	35.63	45.66	60.99	76.35
FlatQuant 2026.03	93.4	94.33	58.96	43.54	50.51	68.15	86.78
GPTQ 2026.03	93.4	93.07	47.92	39.58	49.75	64.74	81.92
SpinQuant 2026.03	93.25	94.33	57.71	49.58	52.12	69.4	88.87
RTN 2026.03	93.1	94.53	53.33	47.08	49.8	67.57	86.06
SmoothQuant 2026.03	93.03	92.73	46.67	40.33	49.19	63.39	81.46
BRQ 2026.03	92.27	91.73	37.29	34.58	48.03	60.78	76.25
RTN 2026.03	92.12	91.13	43.54	38.75	46.97	62.5	78.8