| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Symbolic Reasoning | Coin Flip | Accuracy99.9 | 15 | |
| Symbolic Reasoning | Coin Flip OOD (test) | Accuracy65.7 | 6 | |
| Symbolic Reasoning | Coin Flip (test) | Accuracy98.6 | 6 | |
| Symbolic Reasoning | Coin Flip (OOD) | pass@195.1 | 2 | |
| Symbolic Reasoning | Coin Flip 4 times | Accuracy (format-specific)91.4 | 2 |