QuALITY
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Question Answering | QUALITY | Exact Match83.8 | 10 | |
| Reading Comprehension | QuaLITY | P@176.4 | 6 | |
| Multiple-Choice Question Answering | QuALITY | Accuracy38 | 6 | |
| Question Answering | QuALITY ZeroSCROLLS leaderboard (test) | Accuracy72.8 | 4 | |
| Question Answering | QuALITY hard | Accuracy76.2 | 4 | |
| Question Answering | QuALITY (test) | EM (T)46 | 4 | |
| Reading Comprehension | QuALITY (test) | Accuracy87.6 | 3 | |
| Question Answering | QuALITY (dev) | Exact Match37.6 | 2 |
Showing 8 of 8 rows