Python reference-model generation on ChipBench-SC
43.3Pass@1
ChipMate-Python-9B
Updated 20d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 43.3 | 50 | |
2026.05 | 41.3 | 46.7 | |
2026.05 | 33 | 42.1 | |
2026.05 | 30.7 | 40 | |
2026.05 | 28.7 | 40 | |
2026.05 | 28.7 | 36.7 | |
2026.05 | 28.7 | 33.3 | |
2026.05 | 23.3 | 30 | |
2026.05 | 20 | 26.7 | |
2026.05 | 16.7 | 23.3 |