Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Software Engineering Skill Evaluation on SWE-Skills-Bench python-observability
Loading...
7
Pass Count
Vanilla LLM
2.84
3.92
5
6.08
Jun 15, 2026
Pass Count
Spearman Correlation (ρ)
CNG Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass Count
Spearman Correlation (ρ)
CNG Score
Vanilla LLM
Setting=Vanilla baseline
2026.06
7
-
-
Full Skill Text
Setting=Full Skill Tex...
2026.06
3
18.51
-2.16
S2L
Setting=Our method
2026.06
3
1.78
-22.51
Feedback
Search any
task
Search any
task