Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multilingual Code Generation on HumanEval-X Java
Loading...
100
Quality (%)
Okshot
95.736
96.843
97.95
99.057
Jun 25, 2026
Quality (%)
Cost ($)
Error Rate Reduction (%)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Quality (%)
Cost ($)
Error Rate Reduction (%)
Okshot
k-shot=10
2026.06
100
0.361
100
Okshot
k=1
2026.06
99.4
0.036
85.1
SOTA LLM
2026.06
95.9
0.002
-
SOTA LLM
2026.06
95.9
0.002
-
Feedback
Search any
task
Search any
task
