Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Problem Solving on MATH (Accuracy)

95.86Accuracy

INT4

Updated 21d ago

Evaluation Results

Method	Links
INT4 2026.04		95.86
BF16 2026.04		95.66
BDR-64 2026.04		95.59
BDR-16 2026.04		95.46
BDR-128 2026.04		95.32
Llama-4-Maverick 2026.03		95.2
Llama-3.3-70B 2026.03		94
FineRouter 2026.03		93.8
IPR 2026.03		93.6
Qwen3-235B-A22B 2026.03		93.3
BDR-64 (K) 2026.04		92.71
BDR-128 2026.04		92.63
BF16 2026.04		92.59
kNN 2026.03		92.2
BDR-64 2026.04		92.18
BDR-16 2026.04		92.06
DeepSeek-R1 2026.03		91.6
Claude-Sonnet-4.5 2026.03		91.1
GraphRouter 2026.03		89.6
DeepSeek-v3 2026.03		89
GPT-OSS-120B 2026.03		88.4
Original 2025.08		88.4
VocabTailor 2025.08		88.4
Claude-Haiku-4.5 2026.03		88.1
RouterDC 2026.03		88
VP 2025.08		87.8
RouteLLM 2026.03		87.5
ToolTree 2026.03		78.19
Qwen3-32B 2026.03		75.5
TokenBuncher 2025.08		72.8
Mistral-Large 2026.03		71
Base 2025.08		70.4
ToolTree 2026.03		69.42
OctoTools 2026.03		68.57
RepNoise 2025.08		66.8
Base 2025.08		65.4
TokenBuncher 2025.08		62.8
Few-Shot 2026.03		61.45
MLP 2026.03		59.5
OctoTools 2026.03		58.43
HuggingGPT 2026.03		53.51
Few-Shot 2026.03		53.26
TokenBuncher 2025.08		53
Base 2025.08		52
RepNoise 2025.08		51.8
Baseline 2026.04		49.59
Original 2026.05		48.34
TLPO 2026.04		47.73
HuggingGPT 2026.03		45.14
CTRAP 2025.08		45
CTRAP 2025.08		43.8
ORPO 2026.04		43.78
DPO 2026.04		42
SOMA 2026.05		41.62
SFT 2026.04		41.35
Claude 3.5 Haiku (target) 2026.04		41.3
RepNoise 2025.08		39.8
Original 2026.05		36.48
CTRAP 2025.08		34.4
RouteLLM 2026.05		33.88
Llama 3.1 8B (baseline) 2026.04		31.46
History-FT 2026.05		31.46
SOMA 2026.05		31.14
GARFA (Exp A) 2026.04		28.95
Exp C: Lr+L* 2026.04		28.12
Mistral-Small 2026.03		25.1
RouteLLM 2026.05		25.08
Exp B: L*+Lr 2026.04		25.04
History-Prefix 2026.05		25.03
Exp D: Lr+Lr (control) 2026.04		22.87
History-FT 2026.05		22.57
Surrogate 2026.05		19.2
History-Prefix 2026.05		16.21
Surrogate 2026.05		11.73
INT4 2026.04		0