COGS
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Semantic Parsing | COGS (generalization) | Accuracy (Generalization)99 | 25 | |
| Semantic Parsing | COGS (test) | Exact Match Accuracy99 | 23 | |
| Semantic Parsing | COGS | Accuracy99.5 | 22 | |
| Semantic Parsing | COGS | COGS EM95.84 | 7 | |
| Compositional Generalization | COGS | Exact Match Accuracy83.9 | 6 | |
| Semantic Parsing | COGS nonce | Accuracy81.4 | 6 |
Showing 6 of 6 rows