Winogender
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Attention Head Selection (Causal Tracing) | WinoGender | Loss (10% Sparsity)0.0082 | 24 | |
| Coreference Resolution | Winogender | Accuracy64.72 | 15 | |
| Coreference Resolution | Winogender (test) | Accuracy80.7 | 11 | |
| Coreference Resolution | Winogender (WG) (test) | Accuracy80.8 | 11 | |
| Safety | Winogender | Normalized Log Accuracy65.3 | 9 | |
| Bias Evaluation | WinoGender | EBS0.068 | 8 | |
| Commonsense Reasoning | WinoGender | Accuracy0.9681 | 8 | |
| Multiple-choice scoring | Winogender | Accuracy0.847 | 7 | |
| Co-reference resolution | WinoGender | Accuracy (All)77.5 | 4 | |
| Pronoun Coreference Resolution | Winogender (test) | Accuracy64.5 | 3 |
Showing 10 of 10 rows