Code Comprehension on CVDP (Code Verilog Design Problems) (test)
106Total Passes
phi3.5-mini-instruct
Updated 3mo ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2025.12 | 106 | 56.99 | 47.06 | 37.93 | 82.35 | 92.31 | |
2025.12 | 106 | 56.99 | 50 | 37.93 | 76 | 92 | |
2025.12 | 94 | 50.54 | 58.82 | 37.93 | 47 | 62 | |
2025.12 | 74 | 39.78 | 33.33 | 11.11 | 91.18 | 96.15 | |
2025.12 | 62 | 33.33 | 29.41 | 10.34 | 64.71 | 53.85 | |
2025.12 | 61 | 32.8 | 18.18 | 0 | 82.35 | 96.15 | |
2025.12 | 61 | 32.8 | 13.64 | 6 | 82.35 | 96.15 | |
2025.12 | 14 | 7.53 | 11.76 | 10.34 | 0 | 0 |