Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Python Reference-Model Generation on VerilogEval v2
Loading...
82.4
Pass@1
ChipMate-Python-9B
38.72
50.06
61.4
72.74
May 13, 2026
Pass@1
Pass@5
Updated 20d ago
Evaluation Results
Method
Method
Links
Pass@1
Pass@5
ChipMate-Python-9B
Type=ChipMate-P, Size=9B
2026.05
82.4
84.7
ChipMate-Python-4B
Type=ChipMate-P, Size=4B
2026.05
77.6
80.1
GPT-5.5
Type=Foundation Models...
2026.05
61.5
75.5
DeepSeek Coder
Type=Foundation Models...
2026.05
60.1
73.1
DeepSeek V4
Type=Foundation Models...
2026.05
59.7
71.8
DeepSeek R1
Type=Foundation Models...
2026.05
57.1
70.7
Qwen3.5-9B
Type=Base Models, Size=9B
2026.05
48
64.7
Qwen3.5-4B
Type=Base Models, Size=4B
2026.05
46.8
63.7
CodeV-R1
Type=Specialized Model...
2026.05
45.3
56.4
CodeV-R1 (distill)
Type=Specialized Model...
2026.05
40.4
48.5
Feedback
Search any
task
Search any
task