| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | Django (test) | Accuracy83 | 28 | |
| Semantic Parsing | DJANGO | Generalization Error (G(W))3.4 | 10 | |
| Code Generation | Django | WS Prefix Match75.4 | 4 | |
| Code Generation | DJANGO | Accuracy23.6 | 3 | |
| Software Engineering | Django 64K context 231 samples | Metric- | 0 |