Code Synthesis on MultiPL-E (Lua, Julia, R)
68Success Rate (Lua)
Qwen3-8B-CF-X
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.08 | 68 | 61 | 52 | |
2025.08 | 64 | 54 | 43 | |
2025.08 | 63 | 53 | 44 | |
2025.08 | 61 | 51 | 36 | |
2025.08 | 51 | 62 | 41 |
Qwen3-8B-CF-X
| Method | Links | |||
|---|---|---|---|---|
2025.08 | 68 | 61 | 52 | |
2025.08 | 64 | 54 | 43 | |
2025.08 | 63 | 53 | 44 | |
2025.08 | 61 | 51 | 36 | |
2025.08 | 51 | 62 | 41 |