Share your thoughts, 1 month free Claude Pro on usSee more

Coding on MBPP (pass@1 accuracy)

95.33Pass@1 Accuracy

SwiR

Updated 27d ago

Evaluation Results

Method	Links
SwiR 2025.10		95.33
CoT 2025.10		94.16
Soft Thinking 2025.10		94.16
Claude-Sonnet-4.5 2026.03		93.3
CoT (Greedy) 2025.10		91.44
FineRouter 2026.03		90
Llama-4-Maverick 2026.03		86.7
Claude-Haiku-4.5 2026.03		86.7
DeepSeek-R1 2026.03		86.7
Qwen3-235B-A22B 2026.03		83.3
IPR 2026.03		83.3
MT (Teacher) 2026.04		82.3
GPT-OSS-120B 2026.03		80
MLP 2026.03		80
GraphRouter 2026.03		80
CoT2-Meta 2026.03		79.5
ReST-MCTS* 2026.03		76.8
HPD 2026.04		75.4
Self-SFT 2026.05		75.4
Vanilla ToT 2026.03		75.1
MT (Teacher) 2026.04		74.9
RKLD 2026.04		74.9
JSD 2026.04		74.6
Base 2026.05		74.3
Base 2026.05		74.3
Base 2026.05		74.3
Iter-SFT 2026.05		74.1
DeepSeek-v3 2026.03		73.3
Iter-SFT 2026.05		73.3
Best-of-16 2026.03		72.5
Low-SFT 2026.05		71.4
Low-SFT 2026.05		71.4
Anchored Learning 2026.05		70.4
Anchored Learning 2026.05		70.4
Anchored Learning 2026.05		70.4
Anchored Learning 2026.05		70.4
STM 2026.05		69.3
STM 2026.05		69.3
Greedy CoT 2026.03		68.5
MS (Student) 2026.04		68.5
Low-SFT 2026.05		68
SFT 2026.04		67.7
Anchored Learning 2026.05		67.7
Low-SFT 2026.05		67.7
KD 2026.04		67.5
kNN 2026.03		66.7
Self-sft 2026.05		66.1
Low-SFT 2026.05		65.9
Anchored Learning 2026.05		64.3
KD 2026.04		64
DFT 2026.05		63.5
HPD 2026.04		63.2
Base 2026.05		62.7
SFT 2026.04		61.9
Iter-SFT 2026.05		61.9
RKLD 2026.04		61.6
MS (Student) 2026.04		61.1
JSD 2026.04		61.1
Low-SFT 2026.05		61.1
Self-SFT 2026.05		60.1
STM 2026.05		57.9
DFT 2026.05		57.4
Xuanwu VL-2B 2026.03		50.6
InternVL 3.5 2B 2026.03		49.8
DFT 2026.05		48.1
RouterDC 2026.03		46.7
InternVL 3.0 2B 2026.03		45.6
RouteLLM 2026.03		43.3
Llama-3.3-70B 2026.03		40
Qwen3-32B 2026.03		33.3
Mistral-Small 2026.03		26.7
Mistral-Large 2026.03		23.3
KL-SFT 2026.05		18.5
KL-SFT 2026.05		14.3
KL-SFT 0.2 2026.05		10.1
SFT 2026.05		2.6
SFT 2026.05		1.9
SFT 2026.05		1.2