Coinflip
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Symbolic Reasoning | Coinflip 4 | Accuracy99.5 | 10 | |
| Judgment Consistency | CoinFlip (unseen) | Baseline Score51.8 | 9 | |
| Symbolic Reasoning | CoinFlip | Calibrated Accuracy100 | 8 | |
| Symbolic Reasoning | Coinflip OOD: 4 | Accuracy90.2 | 3 | |
| Symbolic Reasoning | Coinflip OOD: 3 | Accuracy98.6 | 3 | |
| Follow-up Questioning Consistency | CoinFlip (unseen) | Baseline Consistency Score52.2 | 3 | |
| Symbolic Reasoning | Coinflip OOD: 4 (test) | Accuracy- | 0 | |
| Symbolic Reasoning | Coinflip OOD: 3 (test) | Accuracy- | 0 |
Showing 8 of 8 rows