| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| MultiPL-E Java | Min. Prob. | AUROC0.705 | 60 | 6d ago | |
| MultiPL-E Java | CodeBLEU | Brier Score0.231 | 60 | 6d ago | |
| LiveCodeBench Python | Func. Equiv. | AUROC86.7 | 60 | 6d ago | |
| MultiPL-E Java | Min. Tok. Neg. | ECE0.075 | 60 | 6d ago | |
| LiveCodeBench Python | Verb. Conf. | Brier Score0.067 | 60 | 6d ago |
