PIQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Commonsense Reasoning | PIQA | Accuracy94.9 | 757 | |
| Physical Commonsense Reasoning | PIQA | Accuracy94.9 | 724 | |
| Question Answering | PIQA | Accuracy86.5 | 589 | |
| Physical Interaction Question Answering | PIQA | Accuracy94.9 | 462 | |
| Commonsense Reasoning | PIQA | Accuracy89.99 | 400 | |
| Reasoning | PIQA | Accuracy96.5 | 168 | |
| Physical Commonsense Reasoning | PIQA (val) | Accuracy83 | 118 | |
| Zero-shot Reasoning | PIQA | PIQA Zero-shot Accuracy82.54 | 115 | |
| Common Sense Reasoning | PIQA | Accuracy91.89 | 100 | |
| Physical Commonsense Reasoning | PIQA | Accuracy (PIQA)81.5 | 99 | |
| Physical Reasoning | PIQA | Accuracy82.5 | 90 | |
| Physical Commonsense Reasoning | PIQA | Accuracy85.91 | 85 | |
| Commonsense Reasoning | PIQA (test) | Accuracy90.1 | 73 | |
| Physical Commonsense Reasoning | PIQA (test) | Accuracy90.7 | 71 | |
| Multiple Choice Question Answering | PIQA | Accuracy80.5 | 67 | |
| Commonsense reasoning | PIQA 1.0 (test) | Accuracy82.21 | 64 | |
| Physical Commonsense Reasoning | PIQA | Accuracy7,497 | 56 | |
| Physical Commonsense Reasoning | PIQA | Accuracy82.54 | 51 | |
| Physical Commonsense Reasoning | PiQA | Accuracy76.56 | 45 | |
| General Knowledge QA | PIQA | Accuracy80 | 44 | |
| Commonsense Reasoning | PIQA | Normalized Accuracy85.47 | 41 | |
| Question Answering | PIQA (test) | Accuracy85 | 40 | |
| Physical Commonsense Reasoning | PIQA | Accuracy (%)81.08 | 36 | |
| Question Answering | PiQA | Accuracy81.77 | 36 | |
| Physical Reasoning | PIQA | Accuracy91.3 | 34 |
Showing 25 of 101 rows