Code generation on Concode CodeXGLUE (test)
23.4EM
REDCODER
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2021.08 | 23.4 | 41.6 | 43.4 | |
2021.08 | 23.3 | 42.5 | 43.4 | |
2021.08 | 21.4 | 40.2 | 41.8 | |
2021.08 | 20.1 | 32.8 | 36 | |
2021.08 | 18.7 | 33.4 | 35.9 | |
2021.08 | 18.6 | 36.7 | 38.5 | |
2021.08 | 18.3 | 28.7 | 32.7 | |
2021.08 | 18 | 28.7 | 31.4 | |
2021.08 | 17.4 | 25.4 | 29.7 | |
2021.08 | 12.2 | 26.6 | - | |
2021.08 | 10.1 | 24.4 | 29.5 | |
2021.08 | 3.1 | 21.3 | 26.4 | |
2021.08 | 0 | 20.3 | 23.7 | |
2021.08 | 0 | 32.6 | 36.5 |