Complex Reasoning on BIG-bench Hard
39.3Orig Score
FLAN-T5
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2022.12 | 39.3 | 40 | |
| 28.1 | 29.4 | ||
2022.12 | 20.2 | 13.9 | |
| 16 | 29.5 | ||
| 10.2 | 29.7 | ||
2022.12 | 5.8 | 11.8 | |
2022.12 | 0 | 0.7 |
FLAN-T5
| Method | Links | ||
|---|---|---|---|
2022.12 | 39.3 | 40 | |
| 28.1 | 29.4 | ||
2022.12 | 20.2 | 13.9 | |
| 16 | 29.5 | ||
| 10.2 | 29.7 | ||
2022.12 | 5.8 | 11.8 | |
2022.12 | 0 | 0.7 |