CSQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Commonsense Reasoning | CSQA | Accuracy96 | 366 | |
| Commonsense Reasoning | CSQA | CSQA Accuracy91.2 | 195 | |
| Commonsense Question Answering | CSQA (test) | Accuracy0.953 | 127 | |
| Commonsense Reasoning | CSQA (test) | Accuracy89.4 | 123 | |
| Hallucination Detection | CSQA | AUROC85.1 | 107 | |
| Commonsense Question Answering | CSQA | Accuracy88.9 | 71 | |
| Question Answering | CSQA (test) | Accuracy87.2 | 68 | |
| Commonsense Question Answering | CSQA | Accuracy82.72 | 61 | |
| Prompt Injection | CSQA | ASR@318.33 | 52 | |
| Question Answering | CSQA | Accuracy88 | 42 | |
| Prompt Injection | CSQA | ASR62 | 36 | |
| Commonsense Reasoning | CSQA OOD (test) | Accuracy82.1 | 32 | |
| Commonsense Reasoning | CSQA | Task Success Rate (TSR)82.5 | 30 | |
| Malicious Agent | CSQA | ASR@30.49 | 28 | |
| Commonsense Question Answering | CSQA | Accuracy98.9 | 26 | |
| Retrieval-augmented Reasoning | CSQA | Accuracy85.42 | 25 | |
| Question Answering | CSQA | Accuracy (CSQA)86.7 | 24 | |
| Memory Attack | CSQA | ASR@31.67 | 24 | |
| Calibration | CSQA | ECE1.04 | 22 | |
| Question Answering | CSQA (in-domain) | Accuracy86.8 | 22 | |
| Commonsense Reasoning | CSQA | Accuracy88.1 | 20 | |
| General Knowledge QA | CSQA | Accuracy84.1 | 18 | |
| Commonsense Reasoning | CSQA | Accuracy (CSQA)66.4 | 18 | |
| Commonsense Question Answering | CSQA | PIQA84.06 | 18 | |
| Question Answering | CSQA | ECE1.57 | 16 |
Showing 25 of 77 rows