Share your thoughts, 1 month free Claude Pro on usSee more

Verilog Code Generation on VerilogEval CC v2

82.7Pass@1

Deepseek-R1-671B

Updated 1mo ago

Evaluation Results

Method	Links
Deepseek-R1-671B 2025.11		82.7
Deepseek-R1-671B 2025.11		81
Deepseek-R1-671B 2025.11		79.1
CodeV-R1-7B 2025.11		69.9
Deepseek-V3-671B 2025.11		68.7
Deepseek-V3-671B 2025.11		68
QiMeng-CRUX-Final-7B 2025.11		68
QiMeng-CRUX-Final-7B 2025.11		67.6
QiMeng-CRUX-Final-7B 2025.11		66.7
Deepseek-V3-671B 2025.11		66.1
CodeV-R1-Distill-7B 2025.11		65.6
QiMeng-CRUX-SFT-7B 2025.11		65.5
QiMeng-CRUX-SFT-7B 2025.11		64.7
CodeV-Qwen2.5-7B 2025.11		60.4
GPT-4o 2025.11		59
QiMeng-CRUX-SFT-7B 2025.11		58.9
CodeV-Qwen2.5-7B 2025.11		58.3
GPT-4o 2025.11		57.6
GPT-4o 2025.11		56.1
CodeV-Qwen2.5-7B 2025.11		49.9
OriGen-7B 2025.11		49.3
OriGen-7B 2025.11		47.2
Qwen2.5-Coder-32B 2025.11		46.6
Qwen2.5-Coder-32B 2025.11		44.2
Qwen2.5-Coder-32B 2025.11		41.5
RTLCoder-6.7B 2025.11		35.9
RTLCoder-6.7B 2025.11		33.7
RTLCoder-6.7B 2025.11		31.5
Qwen2.5-Coder-7B 2025.11		30.5
Qwen2.5-Coder-7B 2025.11		30.1
Qwen2.5-Coder-7B 2025.11		25.6
Deepseek-Coder-6.7B 2025.11		24.4
Deepseek-Coder-6.7B 2025.11		21