Code Translation

Benchmarks

Dataset Name	SOTA Method	Metric
CodefuseEval	LLAMA3 8B	Ja2Py Score80.5	21	4mo ago
Code Translation dataset	Qwen2.5-Coder-7B + CGBridge	CB73.91	20	4mo ago
Cangjie-bench	ILA-agent	ACC76.36	13	4mo ago
SWIFTBENCH	SWIFTTRANS	Accuracy (C)93.1	11	1mo ago
F2SBench	SWIFTTRANS	Computational Accuracy (C)91.2	11	1mo ago
CodeNet	SWIFTTRANS	Computational Accuracy (C)93.6	11	1mo ago
HumanEval-X (test)	CTO (Qwen2.5-Coder-7B)	CA@1 (C++ to Java)87.19	11	2mo ago
CodeXGLUE C# to Java v1.0 (test)	CodeT5-base	BLEU-479.87	8	4mo ago
CodeXGLUE Java to C# v1.0 (test)	CodeT5-base	BLEU-4 Score84.03	8	4mo ago
Code Trans. (test)	Pre-trained_T5	Exact Match (EM)61.6	8	4mo ago
SWIFTBENCH C-to-Python	SWIFTTRANS	Functional Correctness (%)90.2	6	1mo ago
CodeLingua Java → Fortran		Pass@158.4	6	3mo ago
CodeLingua Python → C		Pass@1 Accuracy86	6	3mo ago
CodeLingua Java → C		Pass@194	6	3mo ago
C#-Java code translation dataset (test)	GraphCodeBERT	BLEU Score72.64	6	4mo ago
Java-C# code translation dataset (test)	GraphCodeBERT	BLEU80.58	6	4mo ago
C#2Java (test)	CodeT5	ASR Score (Syntactic)99.8	6	4mo ago
Java2C# (test)	CodeT5	ASR (Success Rate)96.2	6	4mo ago
TransCoder	PaLM-Coder	Pass@155.1	5	4mo ago
LowTransEval (test)	ILA-agent	Accuracy74.84	5	4mo ago
SWIFTBENCH	SWIFTTRANS	Memory Usage (MB)23.9	4	1mo ago
JS -> TS n = 150	DTV	Pass Count69	4	2mo ago
C -> Rust n = 300	DTV	Pass Count246	4	2mo ago
XLCoST Program-level original (test)	CodeGeeX	CodeBLEU (C++ to Java)84.4	4	4mo ago
XLCoST Snippet-level original (test)	CodeGeeX	C++ -> Java CodeBLEU86.99	4	4mo ago

Showing 25 of 29 rows