Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Software Engineering Skill Evaluation on SWE-Skills-Bench bash-defensive-patterns
Loading...
50
Pass Rate
Vanilla LLM
29.2
34.6
40
45.4
Jun 15, 2026
Pass Rate
Spearman Correlation (ρ)
CNG Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass Rate
Spearman Correlation (ρ)
CNG Score
Vanilla LLM
Setting=Vanilla baseline
2026.06
50
-
-
S2L
Setting=Our method
2026.06
40
-26.6
-0.38
Full Skill Text
Setting=Full Skill Tex...
2026.06
30
12.95
-1.54
Feedback
Search any
task
Search any
task