Specification-to-RTL on VerilogEval SR v2 (test)
77.5Pass@1
DeepSeek-R1-671B
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.05 | 77.5 | 84.7 | 87.4 | |
2025.05 | 68.8 | 78.2 | 81.1 | |
2025.05 | 65.2 | 75.2 | 77.5 | |
2025.05 | 64.2 | 77.3 | 80.1 | |
2025.05 | 64.1 | 73.7 | 76.2 | |
2025.05 | 62.4 | 71.7 | 75 | |
2025.05 | 47.5 | 60.7 | 64.7 | |
2025.05 | 43.9 | 63.3 | 69.2 | |
2025.05 | 31.3 | 49.3 | 54.6 | |
2025.05 | 31.1 | 47.8 | 52.3 | |
2025.05 | 0.6 | 2.2 | 3.5 |