Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Correctness Prediction on Cities
Loading...
88
AUROC
Direction
48.48
58.74
69
79.26
Sep 12, 2025
AUROC
Updated 1mo ago
Evaluation Results
Method
Method
Links
AUROC
Direction
Model=Llama 3.3 70B In...
2025.09
88
Direction
Model=Mistral 7B Instr...
2025.09
88
Direction
Model=DeepSeek R1 Dist...
2025.09
87.9
Direction
Model=Qwen 2.5 7B Inst...
2025.09
84.2
Direction
Model=Ministral 8B Ins...
2025.09
84
Verb. conf.
Model=Qwen 2.5 7B Inst...
2025.09
75.8
Direction
Model=Llama 3.1 8B, Tr...
2025.09
73.2
Assessor
Model=Mistral 7B Instr...
2025.09
71
Assessor
Model=Qwen 2.5 7B Inst...
2025.09
70.8
Verb. conf.
Model=Mistral 7B Instr...
2025.09
70.5
Verb. conf.
Model=Llama 3.3 70B In...
2025.09
69.4
Assessor
Model=Ministral 8B Ins...
2025.09
68.2
Assessor
Model=Llama 3.3 70B In...
2025.09
67.2
Assessor
Model=Llama 3.1 8B, As...
2025.09
66.3
Assessor
Model=DeepSeek R1 Dist...
2025.09
66.3
Verb. conf.
Model=DeepSeek R1 Dist...
2025.09
57.7
Verb. conf.
Model=Ministral 8B Ins...
2025.09
55.4
Verb. conf.
Model=Llama 3.1 8B
2025.09
50
Feedback
Search any
task
Search any
task