| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| MultiPL-E | Pass@1 Score91.2 | 18 | 1mo ago | ||
| Multipl-E | MIRA-Source | MultiplE72.84 | 10 | 1mo ago | |
| HumanEval-X Go | Okshot | Quality (%)98.2 | 4 | 1mo ago | |
| HumanEval-X Java | Okshot | Quality (%)100 | 4 | 1mo ago | |
| HumanEval-X Javascript | Okshot | Quality (%)98.2 | 4 | 1mo ago | |
| HumanEval-X CPP | Okshot | Quality100 | 4 | 1mo ago | |
| HumanEval-X Python | Okshot | Quality100 | 4 | 1mo ago |
