COGS
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Semantic Parsing | COGS (generalization) | Accuracy (Generalization)99 | 25 | |
| Semantic Parsing | COGS (test) | Exact Match Accuracy92.3 | 16 | |
| Semantic Parsing | COGS | Accuracy99.5 | 9 | |
| Compositional Generalization | COGS | Exact Match Accuracy83.9 | 6 | |
| Semantic Parsing | COGS nonce | Accuracy81.4 | 6 |
Showing 5 of 5 rows