Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Synthesis on MultiPL-E (Lua, Julia, R)
Loading...
68
Success Rate (Lua)
Qwen3-8B-CF-X
50.32
54.91
59.5
64.09
Aug 6, 2025
Success Rate (Lua)
Success Rate (Julia)
Success Rate (R)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Success Rate (Lua)
Success Rate (Julia)
Success Rate (R)
Qwen3-8B-CF-X
2025.08
68
61
52
Qwen3-4B-CF-X
2025.08
64
54
43
Qwen 3 8B
2025.08
63
53
44
Qwen 3 4B
2025.08
61
51
36
Qwen3-4B-MBPP-X
2025.08
51
62
41
Feedback
Search any
task
Search any
task