Share your thoughts, 1 month free Claude Pro on usSee more

Instruction Following on Math-IF

61.97IF-RT Score

Staged Decoding

Updated 2d ago

Evaluation Results

Method	Links
Staged Decoding 2026.02		61.97	76.41	69.19
IF-RT chkpt. 2026.02		61.82	37	49.41
IF-RT chkpt. 2026.02		53.11	25.85	39.48
Staged Decoding 2026.02		53.11	82.61	67.86
IF-RT chkpt. 2026.02		51.61	26.1	38.86
Staged Decoding 2026.02		51.61	72.46	62.04
Staged Decoding 2026.02		45.86	66.21	56.04
IF-RT chkpt. 2026.02		45.71	32.73	39.22
IF-RT chkpt. 2026.02		45.38	27.38	36.38
Staged Decoding 2026.02		45.38	45.73	45.56
IF-RT chkpt. 2026.02		41.44	21.69	31.56
Staged Decoding 2026.02		41.37	51.26	46.31
Baseline 2026.02		36.7	59.89	48.29
Avg. IF chkpt. 2026.02		36.4	71.71	54.05
Baseline 2026.02		36.17	73.04	54.61
Avg. IF chkpt. 2026.02		35.12	79.77	57.44
IF-FA chkpt. 2026.02		34.86	77.48	56.17
IF-FA chkpt. 2026.02		34.74	61.22	47.98
Avg. IF chkpt.* 2026.02		34.74	61.22	47.98
Baseline 2026.02		34.54	79.14	56.84
IF-FA chkpt. 2026.02		34.46	72.82	53.64
Baseline 2026.02		34.21	45.28	39.75
IF-FA chkpt. 2026.02		33.73	39.73	36.73
Avg. IF chkpt.* 2026.02		33.73	39.73	36.73
Baseline 2026.02		33.41	63.63	48.52
Baseline 2026.02		30.25	38.81	34.53
IF-FA chkpt. 2026.02		28.87	62.98	45.92
Avg. IF chkpt.* 2026.02		28.87	62.98	45.92
IF-FA chkpt. 2026.02		28.11	36.65	32.38
Avg. IF chkpt.* 2026.02		28.11	36.65	32.38