RTL generation on RTLLM 50 cases (test)
0.42Pass@1
Claude-4.5-Sonnet
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.11 | 0.42 | 0.44 | 0.44 | |
2025.11 | 0.38 | 0.48 | 0.5 | |
| 0.38 | 0.46 | 0.5 | ||
| 0.36 | 0.46 | 0.5 | ||
| 0.36 | 0.46 | 0.5 | ||
2025.11 | 0.34 | 0.42 | 0.48 | |
2025.11 | 0.32 | 0.46 | 0.46 | |
| 0.32 | 0.44 | 0.48 | ||
2025.11 | 0.28 | 0.36 | 0.4 | |
2025.11 | 0.26 | 0.42 | 0.42 | |
| 0.26 | 0.44 | 0.5 | ||
2025.11 | 0.24 | 0.4 | 0.46 | |
2025.11 | 0.24 | 0.34 | 0.38 | |
2025.11 | 0.22 | 0.38 | 0.44 | |
2025.11 | 0.18 | 0.34 | 0.44 | |
2025.11 | 0.04 | 0.28 | 0.4 |