Code Generation on 133 PowerShell CodeGen prompts
46FRate (%)
o3-mini
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 46 | 30 | |
2026.01 | 42 | 34 | |
2026.01 | 24 | 34 | |
2026.01 | 20 | 22 | |
2026.01 | 2 | 0 |
o3-mini
| Method | Links | ||
|---|---|---|---|
2026.01 | 46 | 30 | |
2026.01 | 42 | 34 | |
2026.01 | 24 | 34 | |
2026.01 | 20 | 22 | |
2026.01 | 2 | 0 |