Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Verification on VERINA
Loading...
176
Success Count
IDS
5.44
49.72
94
138.28
Nov 26, 2025
Dec 25, 2025
Jan 24, 2026
Feb 22, 2026
Mar 24, 2026
Apr 22, 2026
May 22, 2026
Success Count
Pass Rate
Percentage Point Difference
Updated 2mo ago
Evaluation Results
Method
Method
Links
Success Count
Pass Rate
Percentage Point Difference
IDS
modality=concurrent co...
2026.05
176
-
-
Claude Code
modality=concurrent co...
2026.05
149
-
-
Codex
modality=concurrent co...
2026.05
136
-
-
Qwen2.5 Coder
Prompting Strategy=Fun...
2025.11
60
-
4.8
Qwen2.5 Coder
Prompting Strategy=Dir...
2025.11
51
-
-
Prior SOTA
modality=concurrent co...
2026.05
38
-
-
Base Goedel
Prompting Strategy=Dir...
2025.11
14
-
-
Base Goedel
Prompting Strategy=Fun...
2025.11
12
-
-1.1
Feedback
Search any
task
Search any
task