Our new X account is live! Follow @wizwand_team for updates

Code Translation on XLCoST Program-level original (test)

84.4CodeBLEU (C++ to Java)

CodeGeeX

Updated 4d ago

Evaluation Results

Method	Links
CodeGeeX 2023.03		84.4	73.89	84.49	82.2	71.18	87.32	87.07	73.11	91.78	84.34	70.61	81.07	82.59	82.49	80.01	77.47	68.91	71.67	87.11	90.46	72.89	83.83	70.58	80.73	85.84	83.85	72.11	85.35	69.8	79.41	87.23	83.9	71.02	85.34	82.81	78.76	88.21	82.46	69.78	85.56	81.21	68.8
CodeT5 2023.03		80.03	71.56	81.73	79.48	70.44	85.67	84.26	69.57	87.79	80.67	69.44	78.78	78.85	73.15	73.35	71.8	67.5	56.35	83.59	85.7	69.52	80.5	69.63	77.35	82.14	79.91	68.42	81.77	68.76	74.57	85.55	82.09	72.26	83.79	81.72	65.86	88.17	76.12	56.32	80.2	76.5	64.28
PLBART 2023.03		75.26	70.13	78.01	61.85	67.01	72.59	81.41	66.29	83.34	80.14	67.12	63.37	74.38	67.8	66.03	69.3	64.85	29.05	80.17	81.37	67.02	79.81	67.12	57.6	80.19	76.96	64.18	78.51	67.24	67.7	79.4	72.77	61.26	74.16	44.26	56.23	78.42	13.45	5.53	45.15	31.47	25.17
CodeBERT 2023.03		74.73	24.96	76.35	72.95	50.4	21.84	79.36	8.51	84.43	76.02	51.42	21.22	68.87	28.22	17.8	23.65	49.3	18.32	78.52	82.25	10.82	75.46	51.76	21.63	75.43	72.33	9.19	75.47	52.08	19.79	50.13	46.81	16.92	49.75	48.12	22.19	21.7	21.27	21.1	19.5	15.64	31.71