| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| HumanEval | Pass@171.57 | 27 | 1mo ago | ||
| SMILES | DreamCoder | U Success Rate4.2 | 20 | 1mo ago | |
| JSON | DreamCoder | U Score56.3 | 20 | 1mo ago | |
| C++ | DiffuCoder | Success Rate U43.9 | 20 | 1mo ago | |
| CPP-Bench | IG-CD | Functional Success Rate @138.1 | 16 | 4mo ago | |
| JSON-Bench | LAVE | Functional Accuracy @155.2 | 16 | 4mo ago |
