Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Python reference-model generation on CVDP cid03
Loading...
43.3
Pass@1
ChipMate-Python-9B
8.876
17.813
26.75
35.687
May 13, 2026
Pass@1
Pass@5
Updated 20d ago
Evaluation Results
Method
Method
Links
Pass@1
Pass@5
ChipMate-Python-9B
Type=ChipMate-P, Size=9B
2026.05
43.3
46.7
GPT-5.5
Type=Foundation Models...
2026.05
41.6
47.4
ChipMate-Python-4B
Type=ChipMate-P, Size=4B
2026.05
34.2
45.3
DeepSeek R1
Type=Foundation Models...
2026.05
26.2
37.2
DeepSeek V4
Type=Foundation Models...
2026.05
24.7
36.5
CodeV-R1 (distill)
Type=Specialized Model...
2026.05
24.7
37.2
CodeV-R1
Type=Specialized Model...
2026.05
22.3
34.6
DeepSeek Coder
Type=Foundation Models...
2026.05
21.5
35.1
Qwen3.5-9B
Type=Base Models, Size=9B
2026.05
11.4
19.9
Qwen3.5-4B
Type=Base Models, Size=4B
2026.05
10.2
12.7
Feedback
Search any
task
Search any
task