Copy
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Copy | Copy OOD lengths: 2x, 4x, 8x, 16x, 32x, 64x | Exact Match Accuracy100 | 30 | |
| Sequence Copying | Copy Length 120 | Accuracy100 | 7 | |
| Copy Task | Copy Eval | Hr94.7 | 6 | |
| Sequence Copying | Copy Length 5020 | Accuracy99.3 | 6 | |
| Copy | Copy ID, n=64 | Exact Match Accuracy100 | 5 | |
| Language Modeling | Copy (test) | Perplexity (PPL)1 | 4 | |
| Language Modeling | Copy | PPL1 | 4 | |
| Sequence Copying | Copy (test) | Per Character Accuracy100 | 4 |
Showing 8 of 8 rows