Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
RTL code generation on Rtllm (test)
Loading...
42
Pass@1
DeepSeek-7B
29.52
32.76
36
39.24
Dec 5, 2025
Pass@1
Pass@5
Updated 4d ago
Evaluation Results
Method
Method
Links
Pass@1
Pass@5
DeepSeek-7B
Forget sets=20%
2025.12
42
44
DeepSeek-7B
Forget sets=0%
2025.12
40
44
DeepSeek-7B
Forget sets=10%
2025.12
40
44
Qwen-7B
Forget sets=0%
2025.12
40
48
Qwen-7B
Forget sets=10%
2025.12
40
48
Qwen-7B
Forget sets=20%
2025.12
40
46
Llama-8B
Forget sets=20%
2025.12
38
42
DeepSeek-7B
Forget sets=30%
2025.12
38
42
Llama-8B
Forget sets=0%
2025.12
36
44
Qwen-7B
Forget sets=30%
2025.12
36
44
Llama-7B
Forget sets=0%
2025.12
34
40
Llama-8B
Forget sets=10%
2025.12
34
44
Llama-7B
Forget sets=10%
2025.12
32
40
Llama-7B
Forget sets=20%
2025.12
32
40
Llama-7B
Forget sets=30%
2025.12
30
38
Llama-8B
Forget sets=30%
2025.12
30
36
Feedback
Search any
task
Search any
task