Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Software Engineering Skill Evaluation on SWE-Skills-Bench performance-optimization v3
Loading...
0
Pass Rate
Vanilla LLM
-0.001
-0.0005
0
0.0005
Jun 15, 2026
Pass Rate
Spearman Correlation (ρ)
CNG Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass Rate
Spearman Correlation (ρ)
CNG Score
Vanilla LLM
Setting=Vanilla baseline
2026.06
0
-
-
Full Skill Text
Setting=Full Skill Tex...
2026.06
0
-33.27
0
S2L
Setting=Our method
2026.06
0
-45.91
0
Feedback
Search any
task
Search any
task