Last Letter Concatenation
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Symbolic Reasoning | Last Letter Concatenation | Accuracy90.4 | 46 | |
| Last-letter-concatenation | Last-letter-concatenation 12 words (out-of-distribution) | Accuracy100 | 15 | |
| Last-letter-concatenation | Last-letter-concatenation 10 words (out-of-distribution) | Accuracy100 | 15 | |
| Last-letter-concatenation | Last-letter-concatenation 8 words (out-of-distribution) | Accuracy100 | 15 | |
| Last-letter-concatenation | Last-letter-concatenation 6 words (out-of-distribution) | Accuracy100 | 15 | |
| Last-letter-concatenation | Last-letter-concatenation 4 words (out-of-distribution) | Accuracy100 | 15 | |
| Last-letter-concatenation | Last-letter-concatenation 2 words (in-distribution) | Accuracy100 | 15 | |
| Last-letter-concatenation | Last-letter-concatenation 1 word (in-distribution) | Accuracy100 | 15 | |
| Symbolic Reasoning | Last Letter Concatenation (test) | Accuracy81.9 | 8 | |
| Symbolic Reasoning | Last Letter Concatenation (LLC) out-of-distribution (test) | LLC-4 Accuracy98 | 7 | |
| Last-letter-concatenation | Last-letter-concatenation 100 words (out-of-distribution) | Accuracy100 | 5 | |
| Last-letter-concatenation | Last-letter-concatenation 50 words (out-of-distribution) | Accuracy100 | 5 | |
| Reasoning | Last Letter Concatenation zero-shot | Accuracy (Zero-shot)70.1 | 4 | |
| Symbolic Reasoning | Last Letter Concatenation OOD: 4 (test) | Accuracy63 | 3 | |
| Symbolic Reasoning | Last Letter Concatenation OOD: 3 (test) | Accuracy94.8 | 3 | |
| Last-letter-concatenation | Last-letter-concatenation 100 words | Accuracy- | 0 | |
| Last-letter-concatenation | Last-letter-concatenation 50 words | Accuracy- | 0 | |
| Last-letter-concatenation | Last-letter-concatenation 12 words | Accuracy- | 0 | |
| Last-letter-concatenation | Last-letter-concatenation 10 words | Accuracy- | 0 | |
| Last-letter-concatenation | Last-letter-concatenation 8 words | Accuracy- | 0 | |
| Last-letter-concatenation | Last-letter-concatenation 6 words | Accuracy- | 0 | |
| Last-letter-concatenation | Last-letter-concatenation 4 words | Accuracy- | 0 | |
| Last-letter-concatenation | Last-letter-concatenation 2 words | Accuracy- | 0 | |
| Last-letter-concatenation | Last-letter-concatenation 1 word | Accuracy- | 0 |
Showing 24 of 24 rows