Paper-to-code reproduction on PaperBench Code ICML 2024 (dev)
0.786Average Score
paper2code + auto-plan & code optimized
Updated 1mo ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| 0.786 | 0.827 | - | 15.25 | 56.88 | ||
| 0.747 | 0.787 | - | 9.53 | 42.98 | ||
| 0.723 | 0.768 | - | 6.01 | 58.23 | ||
2025.12 | 0.682 | 0.692 | - | - | - | |
| 0.655 | 0.655 | - | -3.96 | 32.08 | ||
2025.12 | 0.626 | - | - | - | - |