LSAT
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Logical Reasoning | LSAT HELM | Balanced Accuracy24.38 | 17 | |
| Logical Reasoning Question Answering | LSAT | Pass@10.29 | 11 | |
| Item Response Theory Assessment | LSAT | AUC70.7 | 9 | |
| Human Proficiency Exam | LSAT | Accuracy81.1 | 7 | |
| Question Answering | LSAT (OOD) | Accuracy26.58 | 5 | |
| Logical Reasoning | LSAT | Accuracy37.4 | 5 | |
| Law School Admission Testing | LSAT | Score163 | 3 | |
| Preference Learning | LSAT (test) | AUC0.707 | 2 |
Showing 8 of 8 rows