InterCode
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Interactive Decision Making | InterCode NL2Bash | Success Rate79.6 | 40 | |
| SQL Code Generation | InterCode SQL | Success Rate64.01 | 27 | |
| Bash Command Execution | InterCode Bash | Execution Success Rate72 | 24 | |
| Cybersecurity (CTF) | InterCode CTF | Success Rate57 | 20 | |
| Policy Enforcement | Intercode | Utility100 | 12 | |
| interactive SQL querying | InterCode SQL | Avg Reward69.1 | 10 | |
| Interactive Code Execution | InterCode | Bash Success Rate64.01 | 7 | |
| Probabilistic Verification | Intercode | Average Latency (ms)221 | 2 |
Showing 8 of 8 rows