Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Structural Reasoning on CREAK
Loading...
86.5
Accuracy
Always Tell Me The Odds
40.324
52.312
64.3
76.288
May 2, 2025
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
Always Tell Me The Odds
Backbone=Qwen2.5-14B-I...
2025.05
86.5
Always Tell Me The Odds
Backbone=Qwen2.5-14B-I...
2025.05
85.6
Always Tell Me The Odds
Backbone=Qwen2.5-14B-I...
2025.05
84.8
Always Tell Me The Odds
Backbone=Qwen2.5-8B-In...
2025.05
83.2
Always Tell Me The Odds
Backbone=Qwen2.5-7B-In...
2025.05
82.8
GPT-4o
Evaluation Protocol=0-...
2025.05
81.1
DeepSeek-R1-Distill-Qwen-32B
Evaluation Protocol=0-...
2025.05
68
RoBERTa-L
Type=Encoder, Reasonin...
2025.05
62.5
Llama-3-Instruct
Evaluation Protocol=Pr...
2025.05
42.1
Feedback
Search any
task
Search any
task