Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Response Quality Evaluation on Held-out n=300 (test)
Loading...
0.747
Pearson Correlation Coefficient
DeBERTa Judge
-0.4074
-0.1077
0.192
0.4917
Apr 20, 2026
Pearson Correlation Coefficient
Pearson 95% CI (Lower Bound)
Spearman Correlation Coefficient
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pearson Correlation Coefficient
Pearson 95% CI (Lower Bound)
Spearman Correlation Coefficient
DeBERTa Judge
Params=184M, Latency=1...
2026.04
0.747
0.663
0.733
MiniLM Judge
Params=22M, Latency=13...
2026.04
0.676
0.567
0.685
STS-stsb
Params=66M, Latency=∼0...
2026.04
0.647
0.578
0.698
STS-paraphrase
Params=22M, Latency=∼0...
2026.04
0.629
0.554
0.683
STS-MiniLM
Params=22M, Latency=∼0...
2026.04
0.629
0.558
0.7
TextCNN Judge
Params=10M, Latency=1....
2026.04
0.472
0.346
0.452
CE-MiniLM
Params=22M, Latency=∼0...
2026.04
0.331
0.238
0.357
CE-DeBERTa
Params=184M, Latency=∼...
2026.04
-0.363
0.48
-0.25
Feedback
Search any
task
Search any
task