ZebraLogic
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Logical Reasoning | ZebraLogic | Accuracy98.8 | 48 | |
| Logic Reasoning | Zebralogic | Score96.1 | 42 | |
| Logic Reasoning | ZebraLogic | Accuracy96 | 15 | |
| Logic Reasoning | ZebraLogic | Avg Accuracy @10.817 | 11 | |
| Reasoning | ZebraLogic | Score90.97 | 10 | |
| Constraint Satisfaction Reasoning | ZebraLogic | Easy Score96.8 | 9 | |
| Data-to-Text Generation | ZebraLogic | Schema Validity100 | 8 | |
| Logic Reasoning | Zebralogic | Pass@877 | 6 | |
| Logical Reasoning | ZebraLogic (test) | Error (%)11.13 | 6 | |
| Reasoning | ZebraLogic | Error Rate (%)4.01 | 6 | |
| General Reasoning | ZebraLogic | Mean@196.1 | 4 | |
| Reasoning | ZebraLogic | TPS2,245.5 | 3 | |
| Reasoning | Zebralogic | Accuracy (Zebralogic)78.7 | 3 |
Showing 13 of 13 rows