Code Completion on VerilogEval CC v2 (test)
79.1Pass@1
DeepSeek-R1-671B
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.05 | 79.1 | 85.1 | 87.1 | |
2025.05 | 69.9 | 78.2 | 80.9 | |
2025.05 | 68.7 | 76.3 | 78.2 | |
2025.05 | 65.5 | 75.6 | 78.2 | |
2025.05 | 64 | 77.8 | 80.9 | |
2025.05 | 57.6 | 66.1 | 69 | |
2025.05 | 53.8 | 69.8 | 73.8 | |
2025.05 | 46.6 | 59 | 62.8 | |
2025.05 | 33.7 | 45.9 | 49.8 | |
2025.05 | 30.5 | 46.8 | 52 | |
2025.05 | 2 | 7 | 11.3 |