Our new X account is live! Follow @wizwand_team for updates

Code Generation on MBPP (Acc., TPS)

56.4Accuracy

DSB Cache (greedy)

Updated 4d ago

Evaluation Results

Method	Links
DSB Cache (greedy) 2026.02		56.4	61.85
DSB (greedy) 2026.02		56	55.67
DSB (const.) 2026.02		55.8	60.54
Confidence + Naive 2026.02		55.4	62.03
DSB Cache (greedy) 2026.02		55	108.5
DSB Cache (const.) 2026.02		54.8	115.3
Vanilla 2026.02		54.2	13.54
DSB (const.) 2026.02		54	80.3
Confidence + Naive 2026.02		53.8	80.76
DSB (greedy) 2026.02		53.8	76.9
Dual Naive 2026.02		53.8	57.94
Vanilla 2026.02		53	29.01
Dual Naive 2026.02		53	101.1
DSB Cache (const.) 2026.02		52	59.48
Vanilla 2026.02		39.2	5.32
Confidence + Naive 2026.02		39.2	31.08
DSB Cache (greedy) 2026.02		37	47.61
DSB (const.) 2026.02		36.6	30.58
DSB (greedy) 2026.02		34.8	29.62
Dual Naive 2026.02		34.2	50.61
DSB Cache (const.) 2026.02		34	48.04
DSB (greedy) 2026.02		31	53.56
DSB (const.) 2026.02		30.8	53.35
Confidence + Naive 2026.02		29.6	52.72
Vanilla 2026.02		29.4	14.33
DSB Cache (const.) 2026.02		27.8	82.02
DSB Cache (greedy) 2026.02		27.4	81.88
Dual Naive 2026.02		25.2	76.61