Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Code Generation on MultiPL-E HumanEval translated from Python

54.6C++ Pass Rate

IF-CL

15.360825.547935.73545.9221May 9, 2023Jun 16, 2023Jul 24, 2023Sep 1, 2023Oct 9, 2023Nov 16, 2023Dec 25, 2023
Updated 4d ago

Evaluation Results

MethodLinks
2023.12
54.6---45.3-64.6-53.4-----54.5--50--
2023.12
47.2---44.9-55.3-47.2-----46.2--44.3--
2023.12
47.2---39.8-55.3-44.7-----44.9--41.8--
2023.12
44.4---42.9-57.5-47.6-----40.3--44.1--
2023.12
41.5---41.5-45.9-37-----39.3--37.6--
2023.12
41.4---40.2-41.7-40.4-----38.7--35.3--
2023.12
39.1---39.5-44.7-39.8-----39.7--34.3--
2023.12
39---35.8-41.9-39.3-----27.1--33.7--
2023.12
31.6---30.2-30.8-26.1-----21.8--22.7--
2023.05
31.5521.0113.5717.6130.2223.0230.7923.8926.0817.3433.5715.51.240.0721.8427.6110.4622.7432.29-
2023.12
30.6---28.5-31.7-26.8-----24.5--16.7--
2023.05
30.5922.066.7319.6831.91.5431.2726.2428.9419.2930.7110.9928.637.0525.2227.6211.7422.1231.26-
2023.05
30.5620.5610.0121.4728.5321.0931.726.6126.7516.3230.3510.1817.2511.7724.4628.7911.0216.7432.15-
2023.12
30.2---29.1-35.7-29-----27--27.1--
2023.12
27---29.3-31.7-25.1-----25.5--25.6--
2023.05
218.247.6813.5422.2019.158.58.373.4219.266.4500.664.212.370.611.2520.07-
2023.05
16.878.499.1511.0419.140.2916.9210.9613.518.0921.623.923.343.317.888.952.757.2610.11-
2026.02
-------------------67.7
2026.02
-------------------59.5
2026.02
-------------------45.9
2026.02
-------------------45.7
2026.02
-------------------60.5
2026.01
-------------------59.5
2026.01
-------------------60.5
2026.01
-------------------45.9
2026.01
-------------------45.7