CSQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Commonsense Reasoning | CSQA | Accuracy96 | 366 | |
| Commonsense Reasoning | CSQA | CSQA Accuracy91.2 | 195 | |
| Commonsense Question Answering | CSQA (test) | Accuracy0.953 | 127 | |
| Commonsense Reasoning | CSQA (test) | Accuracy89.4 | 111 | |
| Hallucination Detection | CSQA | AUROC85.1 | 107 | |
| Commonsense Question Answering | CSQA | Accuracy88.9 | 71 | |
| Question Answering | CSQA (test) | Accuracy87.2 | 68 | |
| Commonsense Question Answering | CSQA | Accuracy82.72 | 61 | |
| Prompt Injection | CSQA | ASR@318.33 | 52 | |
| Prompt Injection | CSQA | ASR62 | 36 | |
| Question Answering | CSQA | Accuracy88 | 36 | |
| Commonsense Reasoning | CSQA OOD (test) | Accuracy82.1 | 32 | |
| Commonsense Reasoning | CSQA | Task Success Rate (TSR)82.5 | 30 | |
| Malicious Agent | CSQA | ASR@30.49 | 28 | |
| Retrieval-augmented Reasoning | CSQA | Accuracy85.42 | 25 | |
| Memory Attack | CSQA | ASR@31.67 | 24 | |
| Commonsense Reasoning | CSQA | Accuracy88.1 | 20 | |
| General Knowledge QA | CSQA | Accuracy84.1 | 18 | |
| Commonsense Reasoning | CSQA | Accuracy (CSQA)66.4 | 18 | |
| Commonsense Question Answering | CSQA | PIQA84.06 | 18 | |
| Hallucination Detection | CSQA (CommonsenseQA) | AUROC (128 steps)84.7 | 16 | |
| Prompt Injection Defense | CSQA | ASR@313.4 | 16 | |
| Commonsense Reasoning | CSQA (dev) | Accuracy85.42 | 16 | |
| General Reasoning | CSQA | Accuracy81.3 | 15 | |
| Simple Reasoning | CSQA | Accuracy91.75 | 15 |
Showing 25 of 70 rows