Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Simulation on CruxEval-O
Loading...
62.7
Pass@1
SEC
13.092
25.971
38.85
51.729
Jun 23, 2026
Pass@1
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass@1
SEC
Backbone=Qwen3-4B-Base...
2026.06
62.7
TAC
Backbone=Qwen3-4B-Base...
2026.06
62.1
Random
Backbone=Qwen3-4B-Base...
2026.06
47.6
M2O
Backbone=Qwen3-1.7B
2026.06
41.5
TAC
Backbone=Qwen3-1.7B
2026.06
39.5
M2O
Backbone=Llama3.2-3B
2026.06
37.4
Random
Backbone=Llama3.2-3B
2026.06
36.2
SEC
Backbone=Qwen3-1.7B
2026.06
35.8
TAC
Backbone=Qwen3-0.6B-Ba...
2026.06
35.6
TAC
Backbone=Llama3.2-3B
2026.06
35.5
SEC
Backbone=Qwen3-0.6B-Ba...
2026.06
35.2
Random
Backbone=Qwen3-1.7B
2026.06
34.8
SEC
Backbone=Llama3.2-3B
2026.06
34
Random
Backbone=Qwen3-0.6B-Ba...
2026.06
28.6
Base
Backbone=Llama3.2-3B
2026.06
27.6
Base
Backbone=Qwen3-1.7B
2026.06
15
Feedback
Search any
task
Search any
task
