Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Ranking Preservation on SWE-bench Mini (test)
Loading...
0.922
Mean Spearman Rho
Easiest
0.87936
0.89043
0.9015
0.91257
Mar 24, 2026
Mean Spearman Rho
Std Dev Spearman Rho
Worst Spearman Rho
Best Spearman Rho
Updated 23d ago
Evaluation Results
Method
Method
Links
Mean Spearman Rho
Std Dev Spearman Rho
Worst Spearman Rho
Best Spearman Rho
Easiest
k=20, Selection strate...
2026.03
0.922
-
-
-
MR
k=20, Selection strate...
2026.03
0.92
-
-
-
Random
k=20, Selection strate...
2026.03
0.903
0.026
0.695
0.977
Stratified
k=20, Selection strate...
2026.03
0.902
-
-
-
Greedy
k=20, Selection strate...
2026.03
0.881
-
-
-
Feedback
Search any
task
Search any
task