Symbolic Reasoning on Last Letter Concatenation (LLC) out-of-distribution (test)
98LLC-4 Accuracy
StrategyLLM
Updated 2d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2023.11 | 98 | 86.5 | 51.5 | 78.7 | |
2023.11 | 98 | 87 | 52.5 | 79.2 | |
2023.11 | 98 | 86 | 44 | 76 | |
2023.11 | 81.5 | 25.5 | 0 | 35.7 | |
2023.11 | 68.5 | 22 | 0 | 30.2 | |
2023.11 | 68 | 22 | 0 | 30 | |
2023.11 | 0 | 0 | 0 | 0 |