Share your thoughts, 1 month free Claude Pro on usSee more

Code Generation on MBPP (Accuracy, Runtime, Tokens)

0.406Accuracy

ρ-EOS

Updated 3mo ago

Evaluation Results

Method	Links
ρ-EOS 2026.01		0.406	335.9	594.4	0.555	2.03
ρ-EOS 2026.01		0.396	324	507.4	0.639	2.031
DAEDAL 2026.01		0.394	308.4	558.3	0.552	3.551
Fixed-Length Denoising 2026.01		0.388	336	2,048	0.163	15.172
Fixed-Length Denoising 2026.01		0.387	331	512	0.645	1.728
Fixed-Length Denoising 2026.01		0.375	335	1,024	0.329	4.76
Fixed-Length Denoising 2026.01		0.367	232	256	0.904	0.713
Fixed-Length Denoising 2026.01		0.288	122	128	0.955	0.332
Fixed-Length Denoising 2026.01		0.21	61	64	0.949	0.176