Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multilingual Code Generation on HumanEval-X Go
Loading...
98.2
Quality (%)
Okshot
91.024
92.887
94.75
96.613
Jun 25, 2026
Quality (%)
Cost ($)
Error Rate Reduction (%)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Quality (%)
Cost ($)
Error Rate Reduction (%)
Okshot
k-shot=10
2026.06
98.2
0.339
78.9
Okshot
k=1
2026.06
97.7
0.034
73.9
SOTA LLM
2026.06
91.3
0.006
-
SOTA LLM
2026.06
91.3
0.006
-
Feedback
Search any
task
Search any
task
