Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Logical Reasoning on LSAT
Loading...
54
Accuracy
Glob. non-uni
20.72
29.36
38
46.64
May 16, 2023
Oct 9, 2023
Mar 3, 2024
Jul 27, 2024
Dec 20, 2024
May 15, 2025
Oct 8, 2025
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
Glob. non-uni
Backbone=DS-R1-Distill...
2025.10
54
Loc. uni
Backbone=DS-R1-Distill...
2025.10
53
Glob. non-uni
Backbone=DS-R1-Distill...
2025.10
53
Mean Acc.
Backbone=DS-R1-Distill...
2025.10
52
Self-Cert.
Backbone=DS-R1-Distill...
2025.10
52
Low Ent.
Backbone=DS-R1-Distill...
2025.10
52
Low Ent.
Backbone=DS-R1-Distill...
2025.10
52
High Conf.
Backbone=DS-R1-Distill...
2025.10
51
High Conf.
Backbone=DS-R1-Distill...
2025.10
51
Glob. uni
Backbone=DS-R1-Distill...
2025.10
50
Mean Acc.
Backbone=DS-R1-Distill...
2025.10
50
Loc. non-uni
Backbone=DS-R1-Distill...
2025.10
49
Self-Cert.
Backbone=DS-R1-Distill...
2025.10
49
Loc. uni
Backbone=DS-R1-Distill...
2025.10
49
Loc. non-uni
Backbone=DS-R1-Distill...
2025.10
46
Glob. uni
Backbone=DS-R1-Distill...
2025.10
46
SATLM
Language Model=code-da...
2023.05
37.4
SATLM
Language Model=code-da...
2023.05
35
COT
Language Model=code-da...
2023.05
23.5
COT
Language Model=code-da...
2023.05
23.1
STANDARD
Language Model=code-da...
2023.05
22
Feedback
Search any
task
Search any
task
