ReClor
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Logical Reasoning | ReClor (test) | Accuracy80.6 | 87 | |
| Logical Reasoning Machine Reading Comprehension | ReClor | Accuracy80 | 54 | |
| Logical Reasoning | ReClor (dev) | Accuracy0.786 | 46 | |
| Logical Reasoning | ReClor | Accuracy85.43 | 39 | |
| Logical Reasoning | ReClor Hard (test) | Accuracy87.2 | 37 | |
| Logical Reasoning | ReClor Easy (test) | Accuracy86.4 | 28 | |
| Logical Reasoning | ReClor (test-H) | Accuracy75 | 23 | |
| Logical Reasoning | ReClor (test-e) | Accuracy91.8 | 23 | |
| Logical Reasoning | ReClor v1 (test) | Accuracy78.1 | 23 | |
| Logical Reasoning | ReClor (val) | Accuracy (ReClor val)84.4 | 15 | |
| Logical Reasoning | ReClor 1.0 (test-H) | Accuracy72.9 | 13 | |
| Logical Reasoning | ReClor | Pass@161.8 | 10 | |
| Logical Reasoning | ReClor EASY v1 | Accuracy81.4 | 9 | |
| Logical Reasoning | ReClor 1.0 (test-E) | Accuracy79.09 | 8 | |
| Logical Reasoning | ReClor 1.0 (val) | Accuracy68.4 | 8 | |
| Logical Reasoning | ReClor v1 (test-e) | Accuracy85.2 | 5 | |
| Logical Reasoning | ReClor v1 (dev) | Accuracy81.8 | 5 | |
| Question Answering | ReClor | Accuracy36.67 | 2 | |
| Logical Reasoning | ReClor 300 examples (val) | Accuracy2.7 | 1 |
Showing 19 of 19 rows