Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Paraphrase Identification on MCEval PAWS 8K (test)
Loading...
88.9
Accuracy
Act
48.444
58.947
69.45
79.953
Dec 24, 2024
Accuracy
Updated 3d ago
Evaluation Results
Method
Method
Links
Accuracy
Act
Model=Qwen2.5-7B
2024.12
88.9
Magn-Probe
Model=Qwen2.5-7B
2024.12
87.3
Act
Model=Llama3.1-8B
2024.12
86
Magn-Probe
Model=Llama3.1-8B
2024.12
85.4
Act
Model=Llama3.2-3B
2024.12
84.3
Magn-Probe
Model=Llama3.2-3B
2024.12
83.1
Act
Model=Llama2-7B
2024.12
82.5
Magn-Probe
Model=Llama2-70B
2024.12
82.5
Magn-Probe
Model=Llama2-7B
2024.12
81.5
LM-Prob
Model=Llama2-70B
2024.12
77.9
LM-Prob
Model=Qwen2.5-7B
2024.12
57.4
LM-Prob
Model=Llama2-7B
2024.12
52.4
LM-Prob
Model=Llama3.2-3B
2024.12
50
LM-Prob
Model=Llama3.1-8B
2024.12
50
Feedback
Search any
task
Search any
task