Share your thoughts, 1 month free Claude Pro on usSee more

General Capability Evaluation on ARC-C, HellaSwag, MMLU, GSM8K

54.27ARC-C Accuracy

Pre-trained

Updated 1d ago

Evaluation Results

Method	Links
Pre-trained 2026.06		54.27	59.67	72.62	86.2	68.19
AlphaToken 2026.06		53.13	57.71	71.2	83.14	66.3
Token Cleaning ICML 2025 2026.06		52.76	55.02	68.91	83.54	65.06
STM NeurIPS 2025 2026.06		52.65	57.43	70.63	82.87	65.9
XTF ICLR 2026 2026.06		52.56	57.61	70.51	83.59	66.07
Pre-trained 2026.06		51.45	56.86	59.6	37	51.23
ssTOKEN ICLR 2026 2026.06		51.39	55.17	70.52	82.72	64.95
LoRA ICLR 2022 2026.06		51.27	56.4	69.6	81.97	64.81
AlphaToken 2026.06		51.1	55.12	58.22	36.58	50.26
Token Cleaning ICML 2025 2026.06		50.85	55.84	55.94	33	48.91
LESS ICML 2024 2026.06		50.77	56.45	54.26	31.98	48.37
ssTOKEN ICLR 2026 2026.06		50.58	54.31	57.34	35.2	49.36
STM NeurIPS 2025 2026.06		50.3	56.19	57.3	36.21	50
LESS ICML 2024 2026.06		50.24	57.11	69.68	81.23	64.57
Standard FT 2026.06		50.17	52.63	53.87	24.12	45.2
Standard FT 2026.06		49.25	54.21	66.24	77.92	61.91
LoRA ICLR 2022 2026.06		49.19	55.81	56.71	31.44	48.29
XTF ICLR 2026 2026.06		48.7	53.88	56.33	34.44	48.34
Pre-trained 2026.06		43	55.82	56.54	27.45	45.7
AlphaToken 2026.06		42.76	55.48	56.22	27.4	45.47
LESS ICML 2024 2026.06		42.62	54.62	53.57	22.61	43.36
STM NeurIPS 2025 2026.06		42.02	54.61	55.3	26.22	44.54
ssTOKEN ICLR 2026 2026.06		41.94	53.37	53.1	25.38	43.45
Token Cleaning ICML 2025 2026.06		41.77	52.2	53.94	26	43.48
LoRA ICLR 2022 2026.06		41.62	53.32	50.42	21	41.59
XTF ICLR 2026 2026.06		40.47	52.03	50.69	22.58	41.44
Standard FT 2026.06		39.97	52.45	48.23	20.58	40.31