Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Software Engineering Skill Evaluation on SWE-Skills-Bench python-background-jobs
Loading...
7
Pass Rate
Vanilla LLM
4.92
5.46
6
6.54
Jun 15, 2026
Pass Rate
Spearman Correlation (ρ)
CNG Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass Rate
Spearman Correlation (ρ)
CNG Score
Vanilla LLM
Setting=Vanilla baseline
2026.06
7
-
-
Full Skill Text
Setting=Full Skill Tex...
2026.06
5
-0.142
-1.41
S2L
Setting=Our method
2026.06
5
-0.1808
-1.11
Feedback
Search any
task
Search any
task