BIRD-Python
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | BIRD-Python Original (dev) | Execution Accuracy (Simple)0.6584 | 14 | |
| Code Generation | BIRD-Python Verified | Execution Accuracy (Simple)0.6995 | 14 |
Showing 2 of 2 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | BIRD-Python Original (dev) | Execution Accuracy (Simple)0.6584 | 14 | |
| Code Generation | BIRD-Python Verified | Execution Accuracy (Simple)0.6995 | 14 |