Semantic Parsing on COGS (generalization)
99Accuracy (Generalization)
Lear
Updated 4d ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2023.05 | 99 | - | - | 100 | 99 | 93 | 99 | |
2023.05 | 99 | - | - | - | - | - | - | |
2023.05 | 99 | - | - | - | - | - | - | |
| 93 | - | - | 82 | 91 | 33 | 97 | ||
2023.05 | 92 | - | - | 79 | 85 | 9 | 97 | |
2023.05 | 88 | - | - | 25 | 35 | 0 | 99 | |
2021.10 | 87.6 | - | 0 | 24.6 | 34.7 | - | - | |
2021.12 | 87.4 | - | - | - | - | - | - | |
2023.05 | 87 | - | - | 14 | 14 | 8 | 99 | |
2023.05 | 86 | - | - | 13 | 18 | 0 | 99 | |
2021.10 | 85.9 | - | 0 | 11.4 | 5.7 | - | - | |
2021.10 | 85.9 | - | 0 | 12.5 | 18 | - | - | |
2021.10 | 85.5 | - | 0 | 3.4 | 8.9 | - | - | |
2021.10 | 85.4 | - | 0 | 13.8 | 13.5 | - | - | |
2023.05 | 85 | - | - | 14 | 14 | 0 | 98 | |
2021.10 | 83.3 | - | 0 | 0 | 0 | - | - | |
2021.10 | 82.1 | - | 0 | 0 | 1.3 | - | - | |
2021.12 | 82 | - | - | - | - | - | - | |
2023.05 | 82 | - | - | 0 | 1 | 0 | 96 | |
2021.12 | 81 | - | - | - | - | - | - | |
| 78.4 | - | - | - | - | - | - | ||
2023.05 | 78 | - | - | 100 | 97 | 72 | 76 | |
| 77 | - | - | 73 | 92 | 35 | 79 | ||
2023.05 | 75 | - | - | 71 | 82 | 5 | 79 | |
2021.10 | 66.7 | - | 0 | 0 | 0 | - | - | |
2021.07 | - | 35 | - | - | - | - | - | |
2021.07 | - | 16 | - | - | - | - | - | |
2021.07 | - | 32 | - | - | - | - | - | |
2021.07 | - | 97.7 | - | - | - | - | - | |
2021.07 | - | 94.5 | - | - | - | - | - | |
2021.07 | - | 94 | - | - | - | - | - | |
2021.07 | - | 80.7 | - | - | - | - | - | |
2022.09 | - | 97.7 | - | - | - | - | - | |
2022.09 | - | 89.8 | - | - | - | - | - | |
2022.09 | - | 99.5 | - | - | - | - | - | |
2022.09 | - | 99.2 | - | - | - | - | - |