Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Understanding and Generation on CodeXGLUE
Loading...
46.3
Code Refinement Score
LOGO (Norm)
12.5
21.275
30.05
38.825
Nov 10, 2025
Code Refinement Score
Code Translation (Java -> C#) Score
Code Translation (C# -> Java) Score
Code-to-Text (Java) Score
Code-to-Text (Python) Score
Average Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
Code Refinement Score
Code Translation (Java -> C#) Score
Code Translation (C# -> Java) Score
Code-to-Text (Java) Score
Code-to-Text (Python) Score
Average Score
LOGO (Norm)
Backbone=LLaMA-3.1-8B
2025.11
46.3
11.2
7.6
1
6.1
14.4
LOGO (Entropy)
Backbone=LLaMA-3.1-8B
2025.11
41.5
10.6
11.7
1.1
3.7
13.7
Adapter Soup
Backbone=LLaMA-3.1-8B
2025.11
41.3
9.1
9.2
1.1
1.7
12.5
LoRA Hub
Backbone=LLaMA-3.1-8B
2025.11
33.5
9.7
10.4
1.5
3.2
11.6
LoRA Retriever
Backbone=LLaMA-3.1-8B
2025.11
29.2
10.7
9.4
1.2
1.5
10.4
Base
Backbone=LLaMA-3.1-8B
2025.11
13.8
0.2
1.6
1.8
1.5
3.8
Feedback
Search any
task
Search any
task