Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Verilog generation on CVDP cid03
Loading...
44
Pass@1 Rate
GPT-5.5
10.512
19.206
27.9
36.594
May 13, 2026
Pass@1 Rate
Pass@5 Rate
Updated 20d ago
Evaluation Results
Method
Method
Links
Pass@1 Rate
Pass@5 Rate
GPT-5.5
Type=Foundation Models
2026.05
44
48.7
Claude Opus 4.7
Type=Foundation Models
2026.05
42.8
47.9
ChipMATE-Agents-9B
Type=ChipMATE (Ours),...
2026.05
40.4
44.6
GPT-4o
Type=Foundation Models
2026.05
39
40.4
ChipMATE-Agents-4B
Type=ChipMATE (Ours),...
2026.05
32.1
41.3
ChipMATE-Verilog-9B
Type=ChipMATE (Ours),...
2026.05
28.1
42.1
DeepSeek R1
Type=Foundation Models...
2026.05
27.7
42.1
CodeV-R1
Type=Specialized Model...
2026.05
26.8
43.3
CodeV-R1 (distill)
Type=Specialized Model...
2026.05
26.2
42.1
ChipMATE-Verilog-4B
Type=ChipMATE (Ours),...
2026.05
24.7
39.2
DeepSeek Coder
Type=Foundation Models...
2026.05
22.3
37.2
DeepSeek V4
Type=Foundation Models...
2026.05
21.5
34.6
Qwen3.5-9B
Type=Base Models, Size=9B
2026.05
13.3
21.5
Qwen3.5-4B
Type=Base Models, Size=4B
2026.05
11.8
13.9
Feedback
Search any
task
Search any
task