Template Following on In-house IDE/CLI Agentic Coding Scaffolds
98Scaffold 1 Rate
Deepseek-v3.2
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2026.02 | 98 | 87 | 100 | 92.5 | 91 | 93.7 | |
2026.02 | 98 | 83 | 98 | 91.5 | 93 | 92.7 | |
2026.02 | 92.4 | 57 | 98 | 93.5 | 94 | 87 | |
2026.02 | 91 | 64 | 100 | 94.7 | 0 | 69.9 | |
2026.02 | 86.8 | 61 | 100 | 88 | 91 | 85.4 | |
2026.02 | 85.8 | 86 | 100 | 82.9 | 24 | 75.7 | |
2026.02 | 84 | 14 | 41.8 | 29.8 | 77 | 49.3 | |
2026.02 | 71.5 | 70 | 91.8 | 83 | 80 | 79.3 | |
2026.02 | 68.3 | 48 | 93.8 | 86.2 | 90 | 77.3 | |
2026.02 | 59 | 59 | 100 | 57.4 | 81 | 71.3 |