Our new X account is live! Follow @wizwand_team for updates

RTL generation on RTLLM 50 cases (test)

0.42Pass@1

Claude-4.5-Sonnet

Updated 4d ago

Evaluation Results

Method	Links
Claude-4.5-Sonnet 2025.11		0.42	0.44	0.44
VeriDispatcher (Qwen Emb.-w) 2025.11		0.38	0.48	0.5
VeriDispatcher (OpenAI Emb.-w) 2025.11		0.38	0.46	0.5
VeriDispatcher (OpenAI Emb.-wo) 2025.11		0.36	0.46	0.5
VeriDispatcher (Average+OpenAI Emb.-w) 2025.11		0.36	0.46	0.5
OriGen 2025.11		0.34	0.42	0.48
CodeV-R1-Distill-Qwen-7B 2025.11		0.32	0.46	0.46
VeriDispatcher (Qwen Emb.-wo) 2025.11		0.32	0.44	0.48
RTLCoder-DeepSeek 2025.11		0.28	0.36	0.4
HaVen 2025.11		0.26	0.42	0.42
VeriDispatcher (Average Emb.-wo) 2025.11		0.26	0.44	0.5
RTLCoder-Mistral 2025.11		0.24	0.4	0.46
GPT-5 2025.11		0.24	0.34	0.38
CodeV-DS-6.7B 2025.11		0.22	0.38	0.44
CodeV-CL-7B 2025.11		0.18	0.34	0.44
CodeV-QW-7B 2025.11		0.04	0.28	0.4