Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Generation on MultiPL-E (pass@1 Lua, Julia, R)
Loading...
42
Pass@1 (Lua)
DSC-6.7B-Ins-CF-X
9.76
18.13
26.5
34.87
Aug 6, 2025
Pass@1 (Lua)
Pass@1 (Julia)
Pass@1 (R)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass@1 (Lua)
Pass@1 (Julia)
Pass@1 (R)
DSC-6.7B-Ins-CF-X
Model Size=6.7B, Train...
2025.08
42
55
52
Phi4-mini-ins-CF-X
Training=Agnostics (CF-X)
2025.08
41
43
35
Phi 4 mini ins
Training=Instruction-t...
2025.08
40
39
34
DSC 6.7B Ins
Model Size=6.7B, Train...
2025.08
40
54
37
SmolLM3-3B-CF-X
Model Size=3B, Trainin...
2025.08
14
14
21
SmolLM3 3B
Model Size=3B, Trainin...
2025.08
11
12
18
Feedback
Search any
task
Search any
task