Java
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Student Simulation | Java 5 | Accuracy84 | 72 | |
| Code Search | Java (test) | R@136.1 | 25 | |
| Adversarial Code Compliance | Java | Decoupling Probability91.7 | 9 | |
| Code Generation | Java deduplicated retrieval codebase (test) | EM11.66 | 9 | |
| Code Comment Generation | Java (test) | BLEU Score22.94 | 8 | |
| Java Method Body Generation | Java suite (test) | Undeclared Variable Access Check99.82 | 7 | |
| Code Generation | Java dataset (test) | BLEU27.53 | 6 | |
| Vulnerability Detection | Java P3 X1 (test) | ROC AUC86 | 2 |
Showing 8 of 8 rows