Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Software Engineering Skill Evaluation on SWE-Skills-Bench risk-metrics-calculation
Loading...
5
Pass Rate
Vanilla LLM
0.84
1.92
3
4.08
Jun 15, 2026
Pass Rate
Spearman's Rho
CNG Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass Rate
Spearman's Rho
CNG Score
Vanilla LLM
Setting=Vanilla baseline
2026.06
5
-
-
S2L
Setting=Our method
2026.06
5
0.0912
0
Full Skill Text
Setting=Full Skill Tex...
2026.06
1
0.721
-0.55
Feedback
Search any
task
Search any
task