AbstentionBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Abstention Metacognition | AbstentionBench Normal Prompt | F1 Score67 | 28 | |
| Abstention Metacognition | AbstentionBench Abstention Prompt | F1 Score74.9 | 28 | |
| Abstention | AbstentionBench Clean-merged (test) | Precision92.7 | 10 | |
| Abstention | AbstentionBench KUQ Cont | Abstention F1100 | 4 | |
| Abstention | AbstentionBench QAQA | Abstention F175.8 | 4 | |
| Abstention | AbstentionBench UMWP | Abstention F180.9 | 4 | |
| Abstention | AbstentionBench FreshQA | Abstention F175.2 | 4 | |
| Abstention | AbstentionBench BBQ | Abstention F197 | 4 | |
| Abstention | AbstentionBench BB Known Unk. | Abstention F195.8 | 4 | |
| Abstention Detection | AbstentionBench | Recall53 | 2 |
Showing 10 of 10 rows