WinoGrande
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Commonsense Reasoning | WinoGrande | Accuracy7,364 | 1,581 | |
| Commonsense Reasoning | Winogrande | Accuracy85.3 | 453 | |
| Common sense reasoning | Winogrande | Accuracy91.3 | 189 | |
| Reasoning | WinoGrande (WG) | Accuracy85.2 | 172 | |
| Question Answering | Winogrande (WG) | Accuracy74.1 | 138 | |
| Zero-shot Reasoning | WinoGrande | Accuracy80.51 | 107 | |
| Commonsense Reasoning | Winogrande | Accuracy76.09 | 103 | |
| Commonsense Reasoning | Winogrande | Accuracy74.9 | 94 | |
| Commonsense Question Answering | WinoGrande | Accuracy77.82 | 89 | |
| Commonsense Reasoning | WinoGrande (val) | Accuracy73.88 | 87 | |
| Commonsense Reasoning | WinoGrande 5-shot | Accuracy92.66 | 85 | |
| Coreference Resolution | Winogrande | Accuracy95 | 72 | |
| Common-sense Reasoning | Winogrande | Accuracy85.64 | 67 | |
| Pronoun Resolution | WinoGrande | Accuracy89.4 | 64 | |
| Commonsense Reasoning | Winogrande | Accuracy82.35 | 61 | |
| Commonsense Reasoning | Winogrande | Accuracy (0-shot)73.7 | 42 | |
| Winograd Schema Challenge | WinoGrande | Accuracy76.56 | 39 | |
| Commonsense Reasoning | WinoGrande standard (test) | Accuracy80.2 | 39 | |
| Commonsense Reasoning | WinoGrande (WG) | Accuracy77.5 | 38 | |
| Language Understanding | WinoGrande | Accuracy80.82 | 38 | |
| Commonsense reasoning | WinoGrande 1.0 (test) | Accuracy74.1 | 31 | |
| Identification of inactive attention heads | WinoGrande | Percentage of Zeroed Heads20.91 | 30 | |
| Natural Language Understanding | Winogrande | Accuracy59 | 30 | |
| Zero-shot Accuracy | WinoGrande | Zero-shot Accuracy77.3 | 30 | |
| Common Sense Reasoning | WinoGrande 2021 | Normalized Accuracy78.06 | 26 |
Showing 25 of 92 rows