Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Cipher evaluation on The benchmark (held-out slice)
Loading...
100
Accuracy
Python Solver Oracle
27.824
46.562
65.3
84.038
Jun 20, 2026
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
Python Solver Oracle
type=reverse-engineere...
2026.06
100
Solver-Grounded Synthetic CoT (Model)
adapter=fine-tuned ran...
2026.06
99
Base Model
2026.06
30.6
Feedback
Search any
task
Search any
task
