Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Secure Code Generation on SecHolmesEval
Loading...
1.9
Insecure Generation Rate
P10 Hybrid Pipeline
0.768
8.409
16.05
23.691
Mar 24, 2026
Insecure Generation Rate
Updated 25d ago
Evaluation Results
Method
Method
Links
Insecure Generation Rate
P10 Hybrid Pipeline
Models=CodeLLaMA 7B, M...
2026.03
1.9
CodeLLaMA-7B
Pipeline=P3
2026.03
9.4
Mistral-7B
Pipeline=P3
2026.03
11.3
MetaLLaMA-8B
Pipeline=P3
2026.03
23.6
Gemma-27B
Pipeline=P3
2026.03
25.5
GPT-OSS
Pipeline=Gen
2026.03
27.4
GPT-OSS
Pipeline=P3
2026.03
27.4
Gemma-27B
Pipeline=Gen
2026.03
30.2
Feedback
Search any
task
Search any
task