CodeNet
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Source Code Watermark Extraction Robustness | CodeNet D152 (evaluation) | Accuracy100 | 36 | |
| Source Code Watermark Extraction Robustness | CodeNet D88 (evaluation) | Accuracy100 | 36 | |
| Source Code Watermark Extraction Robustness | CodeNet D56 (evaluation) | Accuracy100 | 36 | |
| Source Code Watermark Extraction Robustness | CodeNet D40 (evaluation) | Accuracy100 | 36 | |
| Source Code Watermark Extraction Robustness | CodeNet D32 (evaluation) | Accuracy100 | 36 | |
| Code runtime regression | CodeNet (test) | Overall MAE240.8 | 18 | |
| Code Translation | CodeNet | Computational Accuracy (C)93.6 | 11 | |
| Spurious Regression | CodeNet | Average Metric Rank2.28 | 9 | |
| Code classification | CodeNet Python800 (test) | Error Rate0.0128 | 7 | |
| Code classification | CodeNet Java250 (test) | Error Rate1.56 | 7 | |
| Clone Detection | CodeNet Python800 1.0 (test) | MAP@R86.01 | 6 | |
| Clone Detection | CodeNet Java250 1.0 (test) | MAP@R86.74 | 6 | |
| Code classification | CodeNet C++1000 (test) | Error Rate6.18 | 4 | |
| Clone Detection | CodeNet C++1000 1.0 (test) | MAP@R60.21 | 4 | |
| Code-to-code Search | CodeNet | MAP79.13 | 4 | |
| Code Watermarking Robustness | CodeNet D32 n=250 | Extraction Rate (No Attack)100 | 3 |
Showing 16 of 16 rows